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server system. The server communication system includes a communication 
application, coupled to a transport layer module, for mamtaining a transport 
layer communication stream with each of a number of client communication 

systems, for accepting requests over the communication systems, for accepting requests over the communication streams from client 
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ENHANCED NETWORK COMMUNICATION 
Background of the Invention 
The invention relates to a distributed directory 
5 of information related to enhanced communication between 
computers coupled over a data network, such as enhanced 
communication between client and server computers coupled 
through the Internet. 

The Internet has become a ubiquitous tool for 

10 accessing and retrieving information, and for conducting 
business in general. Accessing and displaying 
distributed linked multimedia documents on the Internet, 
known as browsing pages on the World Wide Web (the 
"Web"), has become an essential part of information 

15 retrieval both for business and pleasure. The Internet 
has brought previously hard to find information to 
everyone's fingertips. Devices such as commerce servers 
are now enabling business transactions to be conducted 
through the Internet. Due in part to the convenience of 

20 obtaining information and carrying out commercial 

transactions, people are joining the Internet community 
at a very rapid pace. This explosive growth of the 
number of users and the popularity of the available 
services has put a strain on the network which has become 

25 congested. This congestion has lead to users 

experiencing undue delays while trying to retrieve 
information and communicate through the network. The 
congestion also leads to the Internet behaving 
inconsistently. One can experience almost instantaneous 

3 0 response at certain times of the day, while it may appear 
to be impossible to reach the same server at other times 
of the day. Long delays and inconsistency diminish the 
user experience and may result in lost business 
opportunities. . 
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Referring to Fig. 1, client and server computers 
C1-C9, S1-S4 (that is, computers executing the client and 
server applications) are coupled to the Internet 100. 
The Internet itself includes high speed ("backbone") data 
5 connections ( typically operating at data rates in the 
range of 45Mb/s (e.g., T3 capacity telephone trunks) or 
higher connected by switches or routers that forward 
packets towards their destinations. Computers C1-C9, SI- 
S4 are connected to the Internet through network Points 

10 of Presence (POPs) HOa-llOd. A POP typically includes 
routers 112a- 112d that are coupled to the Internet 
through data connections 114a- 114d each having a capacity 
typically in the range of 1.5Mb/s (e.g., a Tl capacity 
telephone connection) to 45Mb/s (T3 capacity). Client 

15 computers C1-C3 can connect to a POP in a variety of 
ways, including those described below. 

Client computers C1-C3 connect directly to a POP 
110a over slow-speed, telephone modem connections 121-123 
communicating a data rates in the range of 28kb/s to 

20 56kb/s. ' 

Clients computers C4-C6 are connected to each 
other within a single location using a local area network 
(IAN) 130 and a single computer or router serves as a 
gateway device 132. This gateway may serve a variety of 

25 functions, including packet routing, packet filtering (a 
security firewall) , and various types of proxy service. 
The connection 124 between gateway device 132 and POP 
110a is similar to that of the individual clients, 
although the data rate is typically higher, for example, 

30 in the range of 128kb/s (e.g., an ISDN telephone 

connection) to serve the requirements of the multiple 
clients. 

Client computers C7-C9 connect directly to a POP 
110b, but access a gateway device 140 at the POP that 
35 acts as a proxy server coupling the clients to a router 
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112b and then to the Internet. The connections 127-129 
between the clients and the POP typically are slow-speed 
telephone modem connection. The connection between the 
client and the proxy server may use standard protocols or 
5 may use a proprietary protocol not generally used 
elsewhere in the Internet. 

Servers S1-S4 are connected to POPs HOc-llOd, 
although the communication capacity between a server site 
and a POP is typically 1.5Mb/s or higher. At the server 

10 sites, local area networks 150, 152 having a capacity of 
lOMb/s or higher couple multiple servers and routers 154, 
156 that are used to communicate with the POPs. 

Internet communication is based on a layered model 
of communication protocols consistent with that published 

15 by the International Standards Organization (ISO) as 
shown in Fig. 2. The set of ISO protocol layers, or 
protocol stack, is numbered from one, at the lowest 
layer, to seven, at the application layer. 

Communication over the Internet is based on 

20 packet -switching techniques. Addressing and transport of 
individual packets within the Internet is handled by the 
Internet Protocol (IP) corresponding to layer three, the 
network layer, of the ISO protocol stack. This layer 
provides a means for sending data packets from one host 

25 to another based on a uniform addressing plan where 

individual computers have unique host numbers and each 
computer has a logical set of numbered ports that can be 
addressed individually. By making use of the IP layer, a 
sending computer is relieved of the task of finding a 

30 route to the destination host. However, packets may be 
lost or damaged and are not guaranteed to be delivered in 
the order sent. Therefore, the sending host needs to 
make sure that the data sent is received successfully and 
that a series of individual packets is assembled 

3 5 appropriately. 
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A common denominator for the Internet is the 
"everything over IP" paradigm. There are protocol 
variations above layer three, for example, various 
application and transport protocols, and protocol 
5 variations below layer three, for example, various 

communication paths making up the network infrastructure, 
but layer three does not change. This allows IP to be 
the sole routing scheme in the Internet thereby enabling 
the worldwide connectivity which is a major ingredient of 

10 its success. 

A transport layer protocol provides end- to- end 
communication between applications executing on different 
computers and regulates the flow of information between 
those applications. Rate and flow control are two 

15 examples of regulations of the flow of information. A 
transport layer protocol may also provide reliable 
transportation of information including, for example, 
in- sequence delivery of information and retransmission of 
lost or damaged information. Today, the Transmission 

20 Control Protocol (TCP) is used almost exclusively to 
provide end-to-end reliable (i.e., error free) data 
streams between computers over the Internet. TCP. is 
layered on the IP protocol and corresponds to ISO layer 
four, the transport layer. 

25 Software that supports the TCP protocol is 

provided on most popular operating systems, such as 
Microsoft Windows 95 and Windows NT, and most variants of 
Unix. An application using TCP is relieved of the 
details of creating or maintaining a reliable stream to a 

3 0 remote application by simply requesting that a TCP-based 
stream be established between itself and a specified 
remote system. 

As a result of TCP being essentially universally 
accepted as the transport protocol, various client server 

3 5 applications have evolved which layer application- 
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specific protocols on top of end-to-end TCP communication 
channels, which are in turn layered on the IP network 
layer. Application layer protocols for file transfer, 
FTP (file transfer protocol), and for Web page access, 
5 HTTP (hyper- text transfer protocol) , are two examples of 
popular application protocols layered on TCP. 

The World Wide Web implements a system in which 
client applications, e.g., browsers such as Netscape 
Navigator or Microsoft Internet Explorer, can access and 

10 display linked documents, called Web pages, through 
server applications using the application layer hyper- 
text transfer protocol, HTTP. An address of a Web page 
or related data, referred to as a URL (uniform resource 
locator) , typically includes a server host name and a 

15 symbolic reference to the data. The browser typically 
establishes a TCP-based connection to a predetermined 
port on the server host. That port is monitored by the 
server process. The client and the server communicate 
using the HTTP protocol over one or more TCP connections. 

20 Today, HTTP version 1.0 is commonly used. 

A Web page typically includes references (URLs) to 
other files that also must be retrieved in order to 
complete the rendering of the originally requested page. 
A browser interprets incoming data from a server, 

25 determines the URL of other files that are needed, and 
establishes concurrent TCP connections to retrieve those 
subordinate files as well. The subordinate files do not 
necessarily come from the same server. .For example, a 
scanned image included on a Web page, such as an 

3 0 advertising banner, will be included in that page as a 

reference to a separate file on a different server. Such 
a scanned image file is retrieved over its own TCP 
connection. 

TCP based communication can use an end-to-end 
35 sliding window protocol where many packets of data can be 
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sent before requiring that data in the first packet is 
acknowledged by the receiver. If one packet is lost or 
damaged, the sender determines after a time-out period 
that the packet needs retransmission and the entire 
5 sequence must be restarted at the un- acknowledged packet 
in a "Go-Back-N" paradigm. The timeout period must be 
significantly greater than a typical round-trip time from 
one host to the other and back to avoid premature 
timeouts. All the packets sent after the lost or damaged 

10 packet are sent again. Since most of the packets sent 
after the lost or damaged packet have likely been 
received successfully, this error recovery procedure 
results in unnecessary use of communication capacity. 
There is no means for the receiver to simply request the 

15 missing packet using TCP . A very small window is 

generally used on channels with high rates of packet loss 
or error. A small window can result in low throughput. 

Fig. 3 shows an exemplary sequence of data 
transfers between a representative client computer CI and 

20 a representative server computer SI using an end-to-end 
TCP channel over a communication path which is 
transported through POPs 110a and 110c and through the 
Internet 100, as shown in Fig. 1. Client computer CI is 
represented in Fig. 3 by vertical line 302 and server 

25 computer SI by vertical line 304. Time flows from top to 
bottom and each arrow represents a data packet traveling . 
across the communication channel. For illustration, we 
assume that TCP is operating with a sliding window size 
of four packets. The client sends a request Rl to the 

30 server who sends back acknowledgment AR1 . The server 

then sends a sequence of data packets D1-D4 and then must 
wait for an acknowledgment to Dl before proceeding. In 
this example, the server can start sending data as soon 
as it has receive the request. Acknowledgments AD1 and 

35 AD2 are received by the server who proceeds to send data 
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packets D5 and D6 . For illustration, the sixth packet D6 
is lost near the midpoint of the communication path. 
Data packets D7-D9 are transmitted after acknowledgments 
AD3-AD5 are received. The server now waits to receive 
5 acknowledgment for the lost sixth packet D6. After a 
time-out period 310, the server retransmits the sixth 
packet D6' and then continues in sequence with the 
retransmissions D7'-D9'. 

Referring to Fig. 4, using HTTP to retrieve data 

10 for a Web page which includes embedded references to 

other data requires several TCP exchanges. Fig. 4 shows 
the sequence of data transfers (without showing the 
acknowledgments) in which client computer CI, represented 
by vertical line 4 02 requests and receives a Web page 

15 from server computer SI, represented by vertical line 
404. No transmission errors are illustrated in this 
case. Acknowledgments are not shown. Client computer CI 
sends a request Gl to server computer SI. Server 
computer SI responds with Web page PI. The client 

20 computer parses page PI and determines that it needs two 
additional documents and issues requests G2 and G3 . 
Server computer SI receives the requests and sends data 
P2 and P3 concurrently to the client computer. 

Fig. 5 shows an exemplary sequence of data 

25 transfers between a representative client computer C4 
that is serviced by a proxy application, hosted on a 
gateway computer 132, and a representative server 
computer SI (Fig. 1) . Client computer C4 is represented 
by vertical line 502, gateway computer 132 is represented 

3 0 by vertical line 504, and server computer SI is 

represented by vertical line 506. Separate TCP channels 
are established between client computer C4 and gateway 
computer 132 and between the gateway computer and server 
computer SI. Communication between the client computer 

35 and the gateway computer uses TCP but encapsulates 
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application-specific requests and responses in a proxy 
protocol. The proxy application strips the proxy 
protocol from outbound packets and forwards them to the 
intended recipient. The proxy application therefore acts 
5 as a server from the point of view of the client 

application and acts as a client from the point of view 
of the server application. Inbound packets are received 
by the proxy application, wrapped with the proxy protocol 
and forwarded to client application. Client computer C4 

10 sends a request Gil to gateway computer 132. Gateway 
computer 132 forwards the request as G12 to server 
computer SI. Server computer SI responds with Web page 
Pll which is forwarded by gateway computer 132 to client 
computer C4 as P12. The client computer parses page P12 

15 and determines that it needs two additional documents and 
issues requests G21 and G31 which are forwarded to server 
computer SI as G22 and G32 by gateway computer 132. 
Server computer SI receives the requests and sends the 
requested data concurrently to the gateway computer as 

20 P21 and P31. The gateway computer forward the data to 
the client computer as P22 and P32. 

Referring to Fig. 1, a proxy application serving 
the same function as that hosted on gateway computer 132 
described above can be hosted on proxy server 14 0. In 

25 this case, a sequence of data transfers between a 

representative client computer C7 that is serviced by a 
proxy server 140 at POP site 110b and a representative 
server SI follows the same pattern as shown in Fig. 5. 
Although the sequence of transfers is the same, in the 

3 0 previous case the data rate between the client 

application and the proxy application is high and the 
connection between the proxy application and the Internet 
is slow, while in this case, the connection between the 
client application and the proxy application is slow and 
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the connection between the proxy application and the 
Internet is high. 

Summary 

In a general aspect, the invention provides 
5 desirable communication characteristics between 

applications executing on computers coupled over a data 
network. For instance, the invention can provide higher 
throughput and reduced latency between a client browser 
application and a Web server application coupled over the 

10 Internet. 

In one aspect, in general, the invention is a 
communication system in which a client communication 
system is coupled to a data network for communicating 
with multiple server communication systems. Each of the 

15 server communication systems is configured to communicate 
with the client communication system using at least one 
of a set of transport layer protocols. The client 
communication system includes a transport layer module 
which implements the set of transport layer protocols. 

20 The client communication system also includes a layered 
communication module coupled to the transport layer 
module. The layered communication module includes a 
protocol selector for receiving a request to communicate 
with a requested one of the multiple server communication 

25 systems and, using this request to communicate, choosing 
one the set of transport layer protocols for 
communication with the requested server system. The 
client communication system can additionally include an 
application coupled to the layered communication module 

3 0 or the client system can include an application which 
includes the layered communication module. Also, the 
client communication system can include a client computer 
programmed to implement the transport layer module, the 
layered communication module, and the application. 



WO 99/01968 



PCT/US98/11928 



- 10 - 

The client communication system can include one or 
more of the following features. 

The system can include a user interface module for 
accepting from a user requests to communicate with server 
5 communication systems and for presenting to the user 
information sent from the server communication system. 
For instance, the user interface module can be part of a 
Web browser application. 

The application can include a server module 

10 coupled to multiple client applications over a local data 
network for accepting requests from the client 
applications to communicate with server communication 
systems and for passing information between the server 
communication systems and the client modules. For 

15 instance, this application can be a proxy server 
application. 

The client communication system can include a 
client computer programmed to implement at least one of 
the client applications and include a proxy computer 

20 programmed to implement the transport layer module, the 
layered communication module, and the application. In 
this arrangement, the client computer and the proxy 
computer are coupled by the local data network. The 
client communication system can also include a second 

25 client computer coupled to the proxy computer over the 

local data network and programmed to implement another of 
the client applications. 

The client communication system can include a 
server table coupled to the protocol selector of the 

30 layered communication module. The server table holds 

information related to the transport layer protocols with 
which server communication systems are configured to 
communicate. The server table can include a first table 
for holding information associating identifications of 

35 server communication systems, such as names or network 
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addresses, and information related to one or more of the 
transport layer protocols that the client communication 
system can use to communicate with each of the identified 
server communication systems. The information related to 
5 the transport layer protocols for a server communication 
system can include an address of a communication server 
computer in the server communication system coupled to 
the data network for communicating with the identified 
server communication system. The server table can also 

10 include a second table for holding information 

associating identifications of server communication 
systems and identifying one or more transport layer 
protocols with which the identified server communication 
systems are not configured to communicate. The client 

15 communication system can include a table interface module 
for providing a user interface for viewing and modifying 
information in the server table. The information in the 
server table related to the transport layer protocols can 
include information related to an expiration time after 

2 0 which some of the information related to the transport 
layer protocols is not longer valid. 

The transport layer module in the client 
communication system. can include a rate control module 
for negotiating a maximum rate of data transmission with 

25 server communication systems. 

The layered communication module can include a 
data compression and decompression module for compressing 
and decompressing data communicated using at least one of 
the transport layer protocols. Also, the layered 

30 communication module can include a security module for 
encrypting and decrypting data communicated using at 
least one of the transport layer protocols. 

At least one of the set of transport layer 
protocols supports selective retransmission and at least 
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one other of the transport layer protocols does not 
support selective retransmission. 

The layered communication module can include a 
multiplexor and a demultiplexor for combining a number of 
5 data streams associated with separate requests to 
communicate with server communication systems into a 
smaller number of transport layer data streams for 
communicating with the server communication systems. 

The client communication system can include a 

10 directory service module coupled to the protocol selector 
of the layered communication module for accessing, over 
the data network, information related to the transport 
layer protocols with which server communication systems 
are configured to communicate. 

15 In another aspect, in general, the invention iis a 

communication system which includes a server 
communication system which is coupled over a data 
communication network to multiple client communication 
systems. The server communication system includes a 

20 transport layer module for communicating with the client 
communication systems and one or more server 
applications. The server communication system also 
includes a communication application coupled to the 
. transport layer module for maintaining a transport layer 

25 communication stream with each of a number of client 
communication systems, for accepting requests over the 
communication streams from client communication systems 
to communicate with the one or more server . applications, 
and for passing information between the client 

30 communication systems and the server applications over 
the communication streams. 

The server communication system can include one or 
more of the following features . 

The server communication system can include a 

35 communication server computer coupled to the data 
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communication network and programmed to implement the 
transport layer module and the communication application. 
The communication server computer can be programmed to 
implement at least one of the server applications. Also, 
5 the server communication system can include an 

application server computer programmed to implement at 
least one of the server applications and a local data 
network coupling the communication server computer and 
the application server computer. 

10 The transport layer module in the server 

communication system can implement a set of two or more 
transport layer protocols. The communication application 
is configured to communicate with the server applications 
using a first of the set of transport layer protocols and 

15 to communicate with client communication systems using a 
second of the set of transport layer protocols. For 
instance, the second transport layer protocol supports 
selective retransmission and the first transport layer 
protocol does not support selective retransmission. 

20 The communication application can be configured to 

limit accepted requests from client communication systems 
to communicate with server applications based on a total 
allocated communication rate of accepted requests. 

The server communication system can include a 

25 server table identifying server applications for which 
the communication application is configured to pass 
information to a client communication system. The server 
communication system can also include a module for 
accepting information to update the server table. 

3 0 The communication application can be configured to 

pass information between more than one server application 
and a client communication system over a single transport 
layer communication stream. 

The server communication system can include an 

35 address translation table for associating network 
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addresses provided by client communication systems as 
identifiers of server applications with local network 
addresses used for communicating between the 
communication application and the server applications. 
5 The address translation table can be configured to 

associate more than one local network address for each 
network address provided by a client communication 
system, and the server communication system can include 
a server selection module for selecting one of the local 

10 addresses in response to a request to communicate from a 
client communication system. The server selection module 
can also include a table for storing' an association 
between a client communication system and a selected 
local network address . 

15 The transport layer module can include a rate 

control module configured to control a total rate of 
communication to each client communication system. Also, 
the communication application can include a compression 
module for compressing information passing from a server 

20 application to a client communication system. The 
communication application can include an encryption 
module for encrypting information passing from a server 
application to a client communication system. 

In another aspect, in general, the invention is a 

25 communication system which includes a server 

communication system coupled over a data network to 
multiple client communication systems. The server 
communication system incudes a transport layer module for 
communicating with the client communication systems using 

3 0 multiple transport layer protocols, a server application, 
and a layered communication module coupled between the 
transport layer module and the server application. The 
layered communication module is for receiving requests 
from the server application to accept communication from 

35 the client communication systems, for maintaining a 
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transport layer communication stream with each of a 
number of the client communication systems, for accepting 
requests over the communication streams from client 
communication systems to communicate the server 
5 application, and for passing information between the 
client communication systems and the server application 
over the communication streams. 

The server communication system can include a 
server computer coupled to the data network and 

10 programmed to implement the transport layer module, the 
server application,, and the layered communication module. 

In another aspect, in general, the invention is a 
method for communicating between a client communication 
system and multiple server communication systems over a 

15 data communication network. The method includes 

accepting a request to communicate including receiving an 
identification of one of the server communication 
systems. The method further includes using the 
identification of the server communication system to 

2 0 select one of multiple transport layer protocols for 

communicating with the server communication system, and 
then communicating with the server communication system 
over the data communication network using the ^selected 
transport layer protocol. 

25 Selecting the transport layer protocol can include 

determining a set of one or more transport layer 
protocols for which the server communication system is 
configured to communicate. Determining the set of 
protocols can include accessing a server table and 

30 retrieving information related to the server 

communication system. Determining the set of protocols 
can also include updating the server table based on data 
received from the server communication system. 
Determining the set of protocols can include retrieving 

35 information related to the server communication system 
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from a directory computer over the data communication 
network. The address of the directory computer can be 
related to the identification of the server communication 
system. For instance, the address of the directory 
5 computer is the same as the address of a server computer 
identified in the request to communicate. 

Accepting the request to communicate can include 
accepting a request to communicate with the server 
communication system using a requested transport layer 

10 protocol for which the server communication system is 

configured to communicate. The selected transport layer 
protocol can be different from the requested transport ' 
layer protocol. 

Accepting the request to communicate with the 

15 server communication system can include accepting a 

request to communicate with a server computer at a first 
network address over the data communication network. The 
method can include selecting a second network address for 
communicating with the server communication system. 

.2 0 Communicating with the server communication system can 
then include communicating with a computer at the second 
network address. The second network address can be 
different from the first network address. 

The method can also include accepting a request 

25 for information through a user interface, providing a 

request to communicate with a server communication system 
based on the request for information, and providing the 
requested information through a user interface. Also, 
accepting the request to communicate can include 

3 0 accepting a request to communicate from a client 
application over a local data network. 

In another aspect, in general, the invention is a 
method for communicating between a server communication 
system and multiple client communication systems over a 

35 data communication network. The method includes 
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establishing a first transport layer communication path 
between the server communication system and one of the 
client communication systems using a first transport 
layer protocol, receiving over the transport layer 
5 communication path a request from the client 

communication system to communicate with a first server 
application, establishing a second communication path to 
the first server application using a second transport 
layer protocol, and passing communication between the 
10 client communication system and the first server 

application over the first transport layer communication 
path and over the second transport layer communication 
path. 

Prior to establishing the second communication 
15 path, the method can include determining whether to 
accept the request to communicate . The second 
communication path is then established only if the 
request is accepted. 

Passing communication can include selectively 

2 0 retransmitting data not correctly received by the client 

communication system. Passing communication can also 
include limiting a total rate of communication with the 
client communication system. 

The method can also include receiving over the 
25 first transport layer communication path a second request 
to communicate with a second server application, 
establishing a third transport layer communication path 
to the second server application using the second 
transport layer protocol, and passing communication 

3 0 between the client communication system and the second 

server application over the first transport layer 
communication path and over the third transport layer 
communication path. The first server application and the 
second server application can be the same but the second 
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transport layer communication path is separate from the 
third transport layer communication path. 

Determining whether to accept the request to 
communicate can include accessing a server table 
5 identifying server applications for which communication 
should be passed. Determining whether to accept the 
request can also include determining whether accepting 
the request would exceed a total communication capacity. 

The method can also include accessing an address 

10 translation table and determining a local network address 
of the first server application. 

Aspects of the invention can include one or more 
of the following advantages. One advantage is improved 
throughput for communication between computers coupled 

15 over a data network. For instance, use of an alternative 
transport layer protocol on some or all of a 
communication path between two computers can improve 
throughput by using a selective retransmission strategy 
to correct errors. 

20 Another advantage is that latency in fulfilling a 

request for data, such as a request for a Web page, can 
be reduced by reducing the number of exchanges needed to 
set up a connection to transfer the data. 

The advantages of the invention do not necessarily 

25 require using modified client or server applications. 
For instance, the client and server applications can be 
configured to communicate with particular transport and 
application protocols, such as TCP and HTTP, while in 
fact, other transport and application layer protocols are 

3 0 used on some or all of the data path joining the 
applications . 

Aspects of the invention can be applied to gateway 
and proxy computers, as well as to client and server 
computers which communicate directly with one another. 
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Other features and advantages of the invention 
will be apparent from the following description, and from 
the claims. 

Description of the Drawings 
5 Fig. 1 illustrates typical coupling of client and 

server computers to the Internet; 

Fig. 2 shows the seven ISO communication protocol 

layers; 

Fig. 3 shows an exemplary sequence of data 
0 transfers between a client computer and a server computer 
using TCP; 

Fig. 4 shows an exemplary sequence of data 
transfers between a client computer and a server computer 
using HTTP; 

5 Fig. 5 shows an exemplary sequence of data 

transfers between a client computer and a server computer 

communicating through a gateway computer using TCP; 

Fig. 6 illustrates a client computer and server 

computers coupled to the Internet and shows a gateway 
0 computer and a remote communication server used for 

communication between the client computer and certain 

server computers; 

Fig. 7 shows an exemplary sequence of data 

transfers between a client computer and a server computer 
5 through a gateway computer and a remote communication 

server; 

Fig. 8 shows an exemplary sequence of data 
transfers between a client computer and a server computer 
using a modified HTTP protocol; 
0 Fig. 9 shows an arrangement of software modules 

which execute on a gateway computer; 

Fig. 9a shows an arrangement of software modules 
which execute on a client computer; 



WO 99/01968 



PCI7US98/11928 



- 20 - 

Fig. 10 is a flowchart of the operation of a 
redirector in response to requests from an application; 

Fig. 11 is a flowchart of the operation of an HTTP 
Engine in response to requests from a redirector; 
5 Fig. 12 shows an arrangement of software modules 

which execute on a remote communication server; 

Fig. 13 shows an arrangement of software modules 
which execute on a server computer which supports 
communication using both TCP and XTP protocols; 
10 Fig. 14 illustrates a client computer coupled over 

the Internet to a Domain Name Server, a list server, and 
a server LAN; 

Fig. 15 shows an arrangement of software modules, 
including a directory module, on a client computer; 
15 Fig. 16 shows a software modules on a client 

computer, including a detailed view of modules that are 
part of the directory module; 

Fig. 17a shows the format of a database record for 
a server computer; 

2 0 Fig. 17b shows the format of a record in a site 

file; 

Fig. 18 is a flowchart of a host name resolution; 

Fig. 19 is a flowchart of a layered service module 
handling a request to connect to a server computer; 
25 Fig. 20 is a flowchart of a directory manager 

handling a request for a remote communication server 
address; 

Fig. 21 is a flowchart of a directory manager 
retrieving remote communication server information and 

3 0 loadable modules; 

Fig. 22 shows software modules, including loadable 
modules, in a layered service module; and 

Fig. 23 shows a network address translator 
coupling a server computers and remote communication 
35 servers to the Internet. 
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Description 
Embodiments of this invention involve 
communication between a client application and a server 
application over a data network, such as the Internet. 
5 An example of such communication is between a client 
application which is a Web browser and a server 
application which is a Web server, although other types 
of client and server applications can be involved as . 
well. Furthermore, although one application is referred 

10 to as the "client" and one as the "server," embodiments 
of this invention are applicable to many situations when 
one application communicates with another over a data 
network and neither is exclusively a client or a server. 
In the description that follows, a client 

15 application executes on a client computer which is 
coupled to the data network. A server application 
executes on a server computer also coupled to the data 
network. A server site includes one or more server 
computers on which server applications can execute, and 

20 in some embodiments of the invention, the server site 
also includes an additional computer used for 
communication between a client application and a server 
application executing at the server site. From the point 
of view of a client application, the combination of 

25 several computers at a server site can be viewed as a 
"server communication system" providing services to the 
client application. Similarly, from the point of view of 
a server application, a single client computer coupled to 
the Internet, or multiple client computers and a gateway 

3 0 or proxy computer can be viewed as a "client 

communication system" requesting services from the server 
application. 

Several embodiments of the invention substantially 
share common functionality implemented in software 
35 modules executing on various computers, including client 
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and server computers as well as other computers, such as 
gateway computers, used for communicating between client 
and server computers . In a first embodiment of the 
invention, both the client communication system and the 
5 server communication system include multiple computers. 
Software modules which implement the common functionality 
are hosted on computers other than client or server 
computers which host the client and server applications. 
In a second embodiment software modules which implement 
10 the common functionality is hosted on the client and 
server computers themselves. Other embodiments use 
various combinations of computers to host software 
modules . 

Referring to Fig. 6, a first illustrative 

15 embodiment of the invention supports communication 

between an exemplary client application 611 executing on 
a client computer 610 and exemplary server applications 
619, 621, 634 executing on server computers 618, 620, 632 
at server sites 616, 630. All the computers are coupled 

20 to Internet 100, which uses the Internet Protocol (IP) 
for network layer (ISO layer 3) communication. Client 
application 611 and server application 619,621,634 are 
configured to use TCP. 

Client application 611 executing on client 

25 computer 610 communicates over the Internet with server 
computers 618, 620, 632 through a gateway computer 612 
that in turn communicates with Internet 100 through POP 
614. A proxy application 613 executes on gateway 
computer 612. Client application 611 is configured such 

30 that when it needs to establish a communication channel 
to a server computer, it contacts proxy application 613 
with a request to establish that communication path. 
Once the communication channel is established further 
communication between client application 611 and the 

35 server computer passes through gateway computer 612 and 
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is handled by proxy application 613. From the point of 
view of a server computer, client computer 610 and 
gateway computer 612 function as a single client 
communication system 606. It appears to the server 
5 computer that an application on gateway computer 612, 
rather than an application on client computer 610, is 
requesting services. For example, the address of the 
client computer is generally not known by the server 
computer. Proxy application 613 can in general handle 

10 multiple communication channels between one or more 
client applications and one or more remote servers. 

Two server communication systems 616, 630 include 
server computers 618, 620 at server communication system 
616 and server 632 at server system 63 0 coupled to LANs 

15 617 and 638 respectively. Routers 622 and 63 6 are 
coupled to LANs 617 and 638 respectively and provide 
access through POP 624 to Internet 100. Server 
applications 619, 621, 634 are hosted on server computers 
618, 620, 632 respectively. Server communication system 

2 0 616 is specially configured in that it also includes a 

remote communication server 626 (a computer) also coupled 
to LAN 617. Remote communication server 626 is used to 
pass certain communication between router 622 and server 
computers 618, 620. Server communication system 630 does 

25 not include a remote communication server computer. 

In this first embodiment, communication between 
client application 611 hosted on client computer 610 and 
server application 619 hosted on server computer 618 at 
server communication system 616 can use two different 

30 types of transport layer communication paths. A first 
type of transport layer communication path is made up of 
two TCP-based segments in series, one between client 
computer 610 and gateway computer 612 executing a proxy 
application 613, and one between gateway computer 612 and 

35 server computer 618. The path followed by the second 
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segment passes from gateway computer 612 to router 615 at 
POP 614, through various communication links and routers 
in Internet 100, then to router 625 at POP 624, to router 
622 on LAN 617 at server site 616, and finally to server 
5 computer 618. 

Communication on the first segment between client 
computer 610 and gateway computer 612 uses TCP as the 
transport protocol. At the application layer, on the 
first segment, client application 611 communicates with 

10 proxy application 613 using a proxy protocol that 

incorporates application protocols used for the end-to- 
end application layer communication between the client 
application and the server application. Oh the second 
segment, proxy application 613 communicates with server 

15 application 619 using the appropriate application layer 
protocol for which the server application is configured. 
Two specific application protocols that are used to 
communicate between client application 611 and server 
applications are HTTP for accessing Web pages and data 

20 embedded in Web pages and FTP for accessing remotely 
stored files. 

A second type of transport layer communication 
path between client application 611 on client computer 
610 and server application 619 hosted on server computer 

25 618 at server communication system 616 uses remote 

communication server 626 to forward communication between 
gateway computer 612 and server computer 618. Rather 
than communicating directly with server computer 618, 
gateway computer 612 communicates with remote 

3 0 communication server 626 which in turn communicates with 
server computer 618, thereby creating three separate 
segments on the path joining client computer 610 and 
server computer 618. The first segment is a direct path 
between client computer 610 and gateway computer 612. 

35 The second segment follows the path from gateway computer 
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612 to router 615 at POP 614, through various 
communication links and routers in Internet 100, then to 
router 625 at POP 624, to router 622 on LAN 617 at server 
site 616, and finally to remote communication server 626. 
5 The third segment is a direct path over LAN 617 between 
remote communication server 626 and server computer 618. 

Communication on the first segment, from client 
computer 610 to gateway computer 612, uses the same 
protocols as on the same segment in the first transport 

10 layer communication path described above. Communication 
on the second segment joining gateway computer 612 and 
remote communication server 626, rather than using TCP, 
uses XTP, an alternate transport layer protocol on the 
second segment. Furthermore, when client application 611 

15 and server application 619 are both using the HTTP 

application layer protocol, a data stream corresponding 
to that HTTP communication uses a modified HTTP protocol. 
Communication over the third segment from remote 
communication server 626 to server computer 618 uses TCP 

20 and standard application layer protocols including HTTP. 
On this second type of transport layer 
communication path from client computer 610 to server 
computer 618 there are three segments at a transport 
layer (ISO layer 4) . At the application layer (ISO layer 

25 7) the communication path is made up of either one 

logical segment or three logical segments. When HTTP is 
not used, there is one logical segment joining the client 
and server application. That is, a sequence of data 
bytes sent by the client application are transported to 

30 the server application unmodified. When HTTP is used, 
there are three logical segments at the application 
layer. The first segment and the third segment use HTTP, 
while the second segment uses a modified HTTP protocol. 
Furthermore, a sequence of' data bytes sent according the 

35 HTTP protocol from client application 611 is not 
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necessarily delivered to server application 619. HTTP 
data streams received at gateway computer 612 and at 
remote communication server 626 are interpreted and are 
not necessarily passed on without modification. Gateway 
5 computer 612 and remote communication server 626 
cooperate to provide the needed translation into 
appropriate protocols for communicating with the client 
and server computers. 

As there is no remote communication server at 

10 server communication system 630, communication between 
client application 611 at client computer 610 and server 
application 634 at server computer 632 uses a two- segment 
TCP-based communication path. The first segment is 
between client computer 610 and gateway computer 612 

15 executing proxy application 613, and the second segment 

■i <=i hetwppn aafpwav n rvrrvrvi i h ^ r* £19 an^ conro-r -ompUter 632. 

The second segment passes from gateway computer 612 to 
router 615 at POP 614, through various communication 
links and routers in Internet 100, then to router 625 at 

20 POP 624, to router 636 on LAN 638 at server communication 
system 630, and finally to server computer 632. Gateway 
computer 612 can concurrently support communication 
directly with server computers as well as via remote 
communication servers. 

25 When client application 611 initiates 

communication with a server application, such as server 
application 619 or server application 634, gateway 
computer 612 determines whether a data path through a 
remote communication server can be established, or 

3 0 whether a direct path to a server computer must be used. 
A path through a remote communication server is preferred 
since such a path can use the alternative transport and 
application layer protocols described above, which 
results in higher data throughput and lower latency than 

35 when using a direct path and standard transport and 
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application layer protocols to communicate between 
gateway computer 612 and a server computer. 

Referring still to Fig. 6, gateway computer 612 
includes CPU 661 and storage 662, such as a magnetic disk 
5 drive. Software stored in storage 662, when executed on 
CPU 661, includes proxy application 613 and communication 
modules 663. Communication modules 663 provide an 
interface for proxy application 613 to communicate with 
client application 611 and with server applications at 

10 the server sites coupled to Internet 100. 

Remote communication server 626 includes CPU 671 
and storage 672. Software stored in storage 672, when 
executed on CPU 671, includes call handler application 
674 and communication modules 673. Communication modules 

15 673 provide an interface for call handler application 674 
to communicate with server applications 619 and 621 and 
proxy application 613. 

Note that the term "module 11 generally is used to 
refer to a component of an operating system or an 

20 application, and "application" . or "application program" 
is used to refer to a separate process managed by an 
operating system. As alternative embodiments can use 
different approaches to coordinate software components, 
the distinction between a component being a "module" or 

25 an "application" is not generally significant. 

In this first embodiment illustrated in Fig. 6, a 
central database 645 is hosted on a directory server 640 
also coupled to Internet 100. Database 645 includes 
information which can be used to identify a remote 

3 0 communication server which is be configured to 

communicate with a particular server computer. This 
database can be used by gateway computer 612 to determine 
whether a request to communicate with a server computer 
can be satisfied by establishing a communication path 

35 through a remote communication server. Each entry in the 
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database 645 associates a network address of a server 
application with certain information needed to set up an 
indirect path to that server application through a remote 
communication server. A network address of a server 
5 application includes a host address and port index of a 
port listened to by that server application. Information 
needed to set up an indirect path includes the network 
address used to connect to an appropriate remote 
communication server. In addition, the database can 

10 optionally be used to indicate that a particular 
application layer protocol is used by the server 
application at a particular server application address. 

In this first embodiment, as introduced above, the 
transport (ISO layer 4) protocol used between gateway 

15 computer 612 and remote communication server 626 is based 
on the express Transport Protocol (XTP) . XTP is layered 
on the IP network protocol (ISO layer 3) which is used to 
route packets which make up the XTP communication between 
gateway computer 612 and remote communication server 626. 

20 XTP also supports bidirectional data communication over a 
single XTP connection. 

XTP has several characteristics that differ from 
TCP and that give it advantages over TCP. One 
characteristic of XTP is that it supports use of a 

25 sliding window in combination with selective 

retransmission of lost or damaged packets. This 
combination allows efficient streaming of data over the - 
XTP based segment joining gateway computer 612 and remote 
communication server 626. 

30 Fig. 7 illustrates an exemplary sequence of data 

transfers involved in sending a request and receiving a 
multipacket reply along a communication path (Fig. 6) 
from client computer 610 through gateway computer 612 and 
remote communication server 626 and finally to server 

35 computer 618. For illustration, vertical lines 710, 712, 
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726, 718 in Fig. 7 represent client computer 610, gateway 
computer 612, remote communication server 626 and server 
computer 618, respectively, and diagonal lines illustrate 
data and acknowledgment packets that pass between the 
5 computers along the communication path. As described 
above, TCP is used on the first segment between client 
computer 610 and gateway computer 612 as well as on the 
third segment from remote communication server 626 and 
server computer 618. XTP is used on the second segment 

10 from gateway computer 612 to remote communication server 
626. In this illustration, both the first and third, 
TCP, segments and the second, XTP, segment operate with a 
sliding window sizes of four packets and each packet is 
explicitly acknowledged. 

15 A request Rll from client computer 610 is 

forwarded by gateway computer 612 as R12, and then 
forwarded by remote communication server 626 as R13 . 
Acknowledgments AR11, AR12, AR13 are sent by gateway 
computer 612, remote communication server 626 and server 

20 compute 618, respectively, when the corresponding request 
packets are received. After acknowledging receipt of 
request R13 , server computer 618 immediately begins 
sending data D11-D19. Remote communication server 62 6 
has a large buffer for data packets and quickly accepts 

25 and acknowledges all the data packets from server 618. 
When remote communication server 626 receives the first 
data packet Dll, it begins sending data D12 to gateway 
computer 612. This continues with data packets D22-D92. 
In this example, it is assumed that data packet D62 is 

3 0 lost at a point between the server computer and the 
client computer and is never acknowledged. Once the 
remote communication server determines that the packet is 
lost, either by a time-out or by an explicit negative 
acknowledgment (NACK) , the remote communication server 

35 retransmits that packet as D62' . Note that since the 
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remote communication server has buffered the data and 
therefore does not have to request retransmission of the 
sixth packet from server 618. The gateway computer 
forwards data packets D12-D52 to client computer 610 as 
5 packets D13-D53 but waits for successful receipt of the 
sixth data packet D62' until it can deliver packets D63- 
D93 in the correct order to the client computer. Fig. 7 
should be contrasted with Fig. 3 which illustrates a 
similar request, and reply on a single TCP connection. 

10 In Fig. 3, in addition to retransmitting the sixth 

packet, the seventh through ninth must be retransmitted 
as well. Also, since there is only one TCP .segment, 
packet retransmissions must pass over the entire path 
from the server computer to the client computer and not 

15 simply over a portion of the path. 

Other transport layer protocol characteristics in 
the XTP segment joining gateway computer 612 and remote 
communication server 626 include explicit rate control, 
which avoids congestion along a communication path, and 

2 0 multiplexing of multiple logical data streams between 

computers, which provides more efficient data transfer. 
Note that TCP does not have a similar explicit mechanism 
for rate control, and uses a separate instance of the TCP 
protocol for each logical data stream. As described more 
25 fully below, each of these characteristics yields 
performance advantages over using TCP. 

With explicit rate control a sending computer can 
limit the rate at which data is sent along a 
communication path based on knowledge of the ability of 

3 0 the data path to transfer data. Referring to Fig. 6, 

consider the data path from remote communication server 
626 and gateway computer 612. Along this path, data 
links of widely varying data rates are traversed. A 
128kb/s link joins gateway computer 612 and POP 614 while 
35 a lOMb/s link joins remote communication server 626 to 
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router 622. If remote communication server 626 sends 
data significantly faster than can be passed over the 
128kb/s link from POP 614 to gateway computer 612, that 
data will have to be buffered somewhere along the path. 
5 This results in various inefficiencies including possible 
loss of a packet due to an overfull buffer, for example, 
a buffer at POP 614. Such a lost packet would only be 
discovered at the other end of the transport layer data 
stream, namely, at gateway computer 612 in this case. 

10 The lost data would then have to be retransmitted over 
the entire path. Rate control is used to limit the rate 
at which remote communication server 626 sends data to 
avoid this problem. In this case, the allowable rate of 
transmission from remote communication server 62 6 would 

15 not be significantly higher than the 128kb/s that can be 
sustained on the link from POP 614 to gateway computer 
612. 

Multiplexing enables a computer to use a single 
instance of the XTP protocol executing for a pair of 

20 computers communicating using XTP to handle multiple 
logical data streams between the two computers. This 
multiplexing capability is in contrast to TCP in which a 
separate instance of the TCP protocol executes 
independently for each logical data stream. An example of 

25 a situation in which multiple data streams are passing 
concurrently between two computers is when a Web browser 
requests data to render a particular Web page. If there 
are embedded references to other data in a Web page, 
separate TCP data streams, each with a separate instance 

3 0 of the TCP protocol, are used to retrieve the referenced 
data. Using XTP, if the data is retrieved from the same 
computer, the multiple data streams are multiplexed and 
use only a single instance of the protocol. 

Bidirectional data communication using XTP enables 

3 5 one to implicitly open a reverse data channel when a 
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forward data channel is open. This is in contrast to TCP 
in which a reverse data channel must be set up using the 
same sequence of exchanges that are required to set up 
the forward data channel. 
5 The previously mentioned modified HTTP protocol is 

used when a client application and a server application 
communicate using the HTTP protocol over an indirect 
communication path through a remote communication server. 
The modified HTTP protocol maintains the format of 

10 underlying data transported over HTTP (such as html 

formatted Web pages) . In a first aspect of the modified 
HTTP protocol, multiple HTTP data streams between the 
client and the server are multiplexed on a single logical 
XTP data stream over the segment joining the remote 

15 communication server and the gateway computer. Note that 
multiplexing of multiple HTTP data streams onto one 
logical XTP data stream is different from and in addition 
to XTP itself multiplexing multiple logical data streams 
between a pair of computers for transmission using a 

20 single instance of the XTP protocol. Moreover, as is 
described further below, not all commands or data pass 
across the entire path from client application 611 to 
server application 619. For example, some client 
application commands , send from the client application to 

25 the proxy application may be handled on the gateway 
computer and may not require services 4 of the remote 
communication server or the server computer. 

A second aspect of the modified HTTP protocol is 
that data is prefetched from server computers 618,621 by 

30 remote communication server 626 and is sent to the 
gateway computer 612 in anticipation of client 
application 611 making an explicit request for the data. 
The data is buffered at gateway computer 612 until it is 
requested by the client application. Remote 

35 communication server 626 determines what data to prefetch 
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based on references embedded in html format Web pages 
that are transferred from server computer 618 or 621 
. through the remote communication server to the client 
application. 

5 Fig. 8 illustrates operation of the modified HTTP 

protocol which involves coordinated operation at the 
remote communication server and the gateway computer. 
This should be contrasted to a similar exchange using an 
end-to-end HTTP based connection shown in Fig. 4. Client 

10 computer 6,10, gateway computer 612, remote communication 
server 626, and server computer 618 (Fig. 6) are 
illustrated as vertical lines 810, 812, 826, 818, 
respectively, in Fig. 8. Transmission of Web page and 
other object requests and responses are shown as arrows 

15 with time increasing from top to bottom in the figure. 
Acknowledgment s- are not illustrated. Client computer 610 
sends an initial " GET" request Gil for a Web page. 
Gateway computer 612 forwards the request from the client 
computer to remote communication server 626 as request 

20 G12. Remote communication server 626 receives G12 and 
requests the Web page from Web server 618 using a 
standard HTTP request G13 . Web server 618 sends the 
requested page Pll to the remote communication server. 
Remote communication server 626 sends as page P12 to 

25 gateway computer 612, which in turn sends page P13 to 
client computer 610. 

Remote communication server 626, in addition to 
forwarding page Pll received from server computer 618 to 
gateway computer 612 as page P12, interprets page Pll if 

30 it is in html format. Page Pll is parsed by an html 
parser and two embedded references to images or other 
objects found on that page are extracted.- For 
illustration, two references in the received page Pll 
result in remote communication server 626 sending 

35 requests G23 and G33 to server computer 618. The server 
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computer responds with data P21 and P31 which are, in 
turn, forwarded by the remote communication server to 
gateway computer 612 as P22 and P32. When this data is 
received by the gateway computer, it is buffered since 
5 client computer has not yet requested the data. The data 
is effectively "prefetched" in anticipation of client 
application 611 on client computer 610 requesting that 
data. When gateway computer receives page P12 from 
remote communication server 626, it forwards that page as 

10 P13 to the client computer where it is interpreted by the 
client application that made the ordinal request 611. 
The client application makes requests G21 and G22 for the 
same data already requested by remote communication 
server 626 in requests G23 and G33 . Gateway computer 612 

15 does not forward the requests G21 and G31 since the data 
P22 and P32 which satisfies these requests has already 
been received and buffered by the gateway computer. The 
gateway computer passes the buffered data to the client 
computer. From the client computer's perspective, the 

20 fact that the data was prefetched is not evident other 
than in that the requests are satisfied with less delay 
than might be expected if requests G21 and G31 had been 
forwarded all the way to server computer 618 before being 
serviced. 

25 There are at least two situations in which remote 

communication server 626 anticipates a request from 
client computer 610 and retrieves and sends the data to 
satisfy the request, but client computer 610 does not 
make the request as expected. The first situation is 

30 when the end user aborts retrieval of a Web page 

interactively with client application 611. In this case, 
client application 611 may never request the data 
referenced in the references embedded in received page. 
According to the HTTP protocol, an abort message is sent 

35 by client computer 610 to gateway computer 612 and this 
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abort message is forwarded to remote communication server 
626. Once the remote communication server receives the 
abort message, further referenced data for that page is 
not sent . Data already sent to the gateway computer is 
5 buffered at the gateway computer but not forwarded to the 
client computer. In order that the buffer at gateway 
computer 612 does not grow too large, oldest unretrieved 
data is discarded by the gateway computer. 

The second situation in which the requests are not 

10 made as expected for the embedded data is when the user 
"follows a link, " that is, a user requests yet another 
page before the current page has been rendered and all 
embedded data has been received. In this case, no abort 
message is sent and all the data is prefetched. If the 

15 user returns to the original page, the embedded data will 
likely still be buffered on the gateway computer and the 
requests for that data can be satisfied without making 
another request of server computer 618. 

Referring to Fig. 9, proxy application 613 and 

20 communication modules 663 executing on gateway computer 
612 implement the functionality of the gateway computer 
as described above. This first embodiment uses the 
Microsoft Windows 95 or Windows NT operating system on 
the gateway computer.. A description of the software 

25 modules that implement the functionality of remote 
communication server 626 follows the description of 
gateway computer 612. 

Proxy application 613 interacts with several 
software modules in order to communicate with client 

30 computer 610, server computer 618, and other server 
computers and remote communication servers . Proxy 
application 613 can be implemented in a variety of ways, 
including those used in a number of commercially 
available proxy application programs. Typically, a proxy 

35 application has a server module 902 which accepts 
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requests from client applications executing on other 
computers, and a client module 904 coupled to the server 
module which communicates with the server systems. 

In order to establish communication paths to 
5 client or server computers, proxy application 613 

requests services from one or more communication software 
modules which implement various communication protocols. 
As normally configured in a typical installation of 
Windows 95 or Windows NT, TCP related requests from proxy 

10 application 613 would be passed directly to transport 

layer modules 940 which include TCP module 916. In this 
embodiment, a layered communication module 93 0 is coupled 
between proxy application 613 and transport layer modules 
940. Layered communication module 930 includes a 

15 software interface module, a "hook, 11 such that all TCP 
related requests from any application, and in particular 
from proxy application 613, are passed to redirector 914. 
The hook can be implemented as a layered service module 
within Winsock2. The redirector can pass these requests 

20 for TCP services to TCP module 916, to XTP module 956, or 
to HTTP Engine 920 which may request services from XTP 
module 956. TCP module 916 and XTP module 956 request 
services from Raw IP module 950 which in turn 
communicates with data and link layer module 952 . Data 

25 and link layer module 952 is responsible for maintaining 
communication links with remote computers including 
client computer 610, server computer 618, and remote 
communication server 626. 

Layered communication module 930 includes a 

30 compression module 918 for optionally compressing and 

decompressing data streams passing to and from transport 
layer modules 940, and a security module 917 for 
optionally encrypting and decrypting the data streams. 
Not shown in Fig. 9 are additional software 

35 interface modules on the paths used to pass communication 
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requests from proxy application 613 to redirector 914, 
from redirector 914 to each of TCP module 916 and XTP 
module 956, and from HTTP Engine 920 to XTP module 956. 
These software interface modules accept requests 
5 according to the Windows Socket (Winsock) API as 

specified my Microsoft and pass the requests on to the 
respective modules. The software interface module on the 
path joining proxy application 613 and redirector 914 is 
implemented by the "hook" software interface module 

10 introduced above, and is configured to pass only TCP 

related requests from the proxy application to redirector 
914. Requests by proxy application 613 for services 
involving other protocols than TCP are passed to other 
software modules which are not shown in the figure. The 

15 software interface module on the paths joining redirector 
914 to TCP module 916 and to XTP module 956, as well as 
on the path joining HTTP Engine 920 to XTP module 956 use 
a Winsock2 module which is a dynamically linked library 
supplied by Microsoft. Winsock accepts requests 

20 according to the Winsock API and makes requests according 
to the Winsock Service Provider Interface (SPI) . 

Proxy application 613, as well as other modules 
using the Winsock API, request communication services in 
multistep sequences. These steps can include the 

25 following types of requests: 

A. Request creation of a "socket" using a particular 
communication protocol, such as TCP or XTP. At any one 
time, this socket can be used for a single data stream. 
On successful completion of the request, a "handle" to 

3 0 the socket, an unsigned scalar index, is returned. 

Further requests related to this socket use the socket 
handle to identify the socket. 

B. Request that an outbound communication channel be 
established to (connected to) a remote computer. For 

35 TCP/IP, the remote host address and port index are 
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specified as the terminating end of the communication 
channel . 

C. Request that an inbound communication channel be 
established (listened for and accepted) from a remote 

5 computer on a particular port. The port may be the port 
already used for an outbound channel established in a 
step B above, or may be explicitly specified. 

D. Send data on the outbound communication channel. 

E. Receive data from the inbound communication 
10 channel. 

Proxy application 613 makes a series of these 
communication requests specifying TCP as the 
communication protocol to be used. These requests are 
passed to redirector 914. In particular, in order to 
15 accept a connection from client computer 610 and then 

open a connection to server computer 618 on behalf of the 
client computer, client application 613 executes a series 
of communication requests including: 

1. Create a socket (A) for communicating with client 
20 computer 610 using TCP. 

2 . Listen for and accept an inbound communication 
channel (C) on a particular port known to the client 
computer. 

3. Request that an outbound communication channels be 
25 open (B) to the client cpmputer. The port index at the 

client computer is the source port of the inbound 
communication channel. 

4. Receive data (E) from the client computer. This 
data includes the address of server computer 618 with 

30 whom the client computer requests to communicate. 

5. Create a second socket (A) for communicating using 

TCP. 

6. Connect to server computer 618 (B) using the 
second socket . 
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7. Send data (D) (a request) received from client 
computer 610 to server computer 618. 

8. Listen for an inbound channel (C) from server 
computer 618 on the port used for the outbound 

5 communication with the server computer. 

9. Receive data (E) using the second socket from the 
server computer. 

10. Send the received data (D) using the first socket 
to client computer 610. 

10 Proxy application 613 makes the same of Winsock 

API requests regardless of whether a server computer is 
at a specially configured server site or a normally 
configured server site. The proxy application is not 
aware at the point of making the request whether a 

15 communication path through a remote communication server 
can be established, nor is it aware after communication 
has been established whether a direct TCP connection has 
been made to a server computer or whether an XTP 
connection has been made to a remote communication 

2 0 server. 

At the application layer, when client application 
611 communicates with server application 619 using HTTP, 
client application 611 creates an outbound data stream 
and receives an inbound data stream according to the HTTP 
25 protocol. When client application 611 sends HTTP data to 
proxy application 613, the proxy application requests 
that the data be written to an open socket but does not 
otherwise interpret it. Proxy application 613 makes the 
same request to write HTTP data regardless of whether it 

3 0 is communicating with a specially configured server site 

or a normally configured server site. The proxy 
application is not aware whether the HTTP data will be 
sent to server computer 618 over a TCP connection, sent 
first to remote communication server 626 using the 
35 modified HTTP protocol and XTP protocol, or handled on 
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the gateway computer without requiring communication with 
any other computer. 

In the sequence of requests executed by proxy 
application 613 enumerated above, redirector 914 passes 
5 all the requests related to first socket, which is used 
to communicate with client computer 610, to TCP module 
916. Communication between proxy application 613 and 
server application 619, hosted on server computer 618, 
over a direct path between gateway computer 612 and 

10 server computer 618 passes through redirector 914, TCP 
Module 916, and finally Raw IP module 950 and data and 
link layer module 952. Communication between proxy 
application 613 and a remote communication server passes 
through redirector 914, may pass through HTTP Engine 920, 

15 passes through XTP module 956, Raw IP module 950 and 
finally data and link layer module 952. XTP module 956 
implements a similar level of functionality as TCP module 
916 using XTP as the transport layer protocol rather than 
TCP. HTTP engine 920 interprets data streams passing 

2 0 through it and implements the client end of the modified 

HTTP protocol used on the communication segment between 
gateway computer 612 and remote communication server 626. 

In order to determine whether an indirect 
communication path to a server computer can be 
25 established through a remote communication server, a 

protocol selector 923 in redirector 914 uses information 
obtained from central database 645 on directory server 
640. This information is used to determine if a suitable 
remote communication server is available and if so, the 

3 0 address of that remote communication server. The host 

name or network address of directory server 640 is 
preconf igured in proxy application 613. 

Rather than accessing central database 645 
whenever it needs to establish a communication path to a 
35 server application, redirector 914 maintains server 
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tables 924 that reflect some of the information in 
central database 645. A first table, "instable" 926, 
includes a subset of the entries in central database 645. 
If an entry is found in this table, the central database 
5 does not have to be queried since the information in 
central database 645 is available locally. A second 
table, ,! out_table H 928, includes addresses of server 
applications known to not have entries in central 
database 645. If a server application does not have an 

10 entry, that server application is accessed using a direct 
communication path between the gateway computer and a 
server computer. If a server address is found in 
out_table, there is no reason to query directory server 
64 0 since it is known locally at gateway computer 612 

15 that no entry will typically be found. These two tables 
are updated based on information in central database 645. 
A user interface application 912 is also coupled to 
server tables 924 to allow a user to view and modify 
information in the tables.* 

20 TCP module 916 receives calls from redirector 914 

to open and communicate using the TCP protocols. TCP 
module 916 receives requests from redirector 914 using 
the Winsock SPI. When the TCP module 916 receives a 
request from redirector 914, the redirector is 

25 essentially transparent. A call to the TCP module is 
essentially identical to the call that would have 
occurred in a typical installation of Windows 95 or 
Windows NT in which all TCP requests are passed directly 
to the TCP module rather than to redirector 914. 

30 TCP module 916 maintains socket data 931 which is 

used to store information about sockets it creates on 
behalf of applications such as proxy application 613. 
The socket data is used, for instance, to map a socket 
handle with an open data connection to a local port index 

35 and a remote host address and port index. In addition, 
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TCP module 916 includes data buffers 933 for connected 
inbound and outbound channels, and receiver and 
transmitter modules 936,948 used to implement the TCP 
protocol independently for each inbound or outbound 
5 connection. TCP module 916 communicates with Raw IP 
module 950, which implements the IP protocol layer, and 
which in turn communicates with a link and physical layer 
module 952. The link and physical layer modules is 
responsible for the communicating over the physical 

10 connections including those to client computer 610 and to 
router 615 at POP 614. 

In addition to forwarding requests to TCP module 
916, redirector 914 can also forward requests received 
from proxy application 613 to XTP module 956 and to HTTP 

15 Engine 92 0. Redirector 914 passes to XTP module 956 
requests to open communication channels to and 
communicate with specially- configured server sites in the 
case that the data stream on that channel does not 
necessarily use the HTTP application layer protocol. 

20 Redirector 914 uses HTTP Engine 920 for HTTP based 

connections to specially configured server sites. Along 
with a TCP request, redirector 914 provides HTTP Engine 
92 0 the TCP socket handle used by the client application 
and the address of a remote communication server that 

25 will receive the XTP communication. 

XTP module 956 implements the XTP protocol. 
Logical data streams associated with XTP sockets are 
associated with XTP contexts. The logical structure of 
the XTP module is very similar to that of TCP module 916 

30 except that all logical data streams to or from a 

particular host are multiplexed into a single data stream 
communicated using the XTP protocol whereas in the TCP 
module, each logical stream uses a separate instance of 
the TCP protocol. XTP module 956 includes data buffers 

35 965 for connected inbound and outbound channels, and 
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receiver and transmitter modules 966, 976 used to 
implement the XTP protocol for each multiplexed data 
stream to a remote computer. XTP module 956 communicates 
with Raw IP module 950, which implements the IP network 
5 protocol layer, and which in turn communicates with a 
link and physical layer module 952. The link and 
physical layer module is responsible for the 
communicating over the physical connections including 
those to client computer 610 and to router 615 at POP 

10 614. XTP module 956 maintains socket data 957 which is 
used to store information related to sockets created by 
the XTP module. Communication for multiple sockets 
between gateway computer 612 and a remote computer is 
multiplexed and demultiplexed by receiver and transmitter 

15 modules 966, 976 in XTP module 956 into a single inbound 
and a single inbound data stream and uses a single 
instance of the XTP protocol for each such stream. 
Socket data 957 is used to associate a socket handle with 
the local and remote port indices, as well as a key 

20 associated with the data stream associated with the 

socket. XTP module 956 includes a rate control module 
977 for negotiating the data rate and then limiting the 
data rate to server systems. 

An XTP based communication path between gateway 

25 computer 612 and a remote communication server is 

maintained for a period of time after all contexts are 
closed. If the client application tries to open a new 
connection to the remote communication server during this 
period, the connection is open with very little overhead. 

30 The period of time the connection persists, the "keep- 
alive time," can be a fixed interval or can be determined 
adaptively based on past communication characteristics. 

Redirector 914 can also send a request to HTTP 
Engine 920 if it determines that a TCP request received 

35 from proxy application 613 corresponds to HTTP-based 
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communication to a specially-configured server site. 
HTTP Engine 920 interprets the application layer HTTP 
protocol used on a data connection. The HTTP Engine 
performs two functions in addition direct translation of 
5 TCP requests into XTP requests. First, the information 
in multiple HTTP data streams passing between the gateway 
computer and a particular remote communication server are 
multiplexed in HTTP multiplexor 982 for communicating 
using a single XTP context. Second, the HTTP Engine 

10 maintains prefetch buffers 984 which are used to service 
some HTTP requests for data. The HTTP multiplexor fills 
the prefetch buffers with data that has not yet been 
requested and provides the buffered data when a request 
can be satisfied with that data. 

15 Redirector 914 maintains two additional data 

structures used in redirecting requests from proxy 
application 613 to the appropriate communication modules. 
When proxy application 613 requests creation of a TCP 
based socket, a TCP socket is indeed created for the 

20 proxy application and its handle is returned to the proxy 
application. At later point when proxy application 613 
requests connection to a particular server computer, a 
second XTP based socket may be created at the request of 
redirector 914 if indirect communication with the server 

25 computer through a remote communication server is to be 
established. Redirector 914 maintains socket association 
table 915 which associates the TCP socket handle known to 
the proxy application and the XTP socket handle used for 
communicating with a remote communication server. Socket 

30 association table 915 also includes information needed to 
determine which communication module should handle 
requests for that socket. 

Redirector 914 also includes a tracing buffer 927 
used to record (trace) certain requests from proxy 

35 application 613 that are passed on to TCP module 916. In 
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particular, after the proxy application requests creation 
of a TCP socket, other requests related to that socket 
may be made by the proxy application prior to receiving a 
request to listen for an inbound connection or to connect 
5 to a particular remote computer. It is not until a 
request to establish a connection is received by 
redirector 914 that a determination can be made that the 
communication should use XTP rather than TCP. Therefore, 
these initial TCP requests are recorded in tracing buffer 

10 927. If redirector 914 determines that an XTP socket 
should be created and associated with a previously 
created TCP socket, the recorded requests related to the 
TCP socket are "replayed 11 to the XTP socket. In this 
way, the XTP socket will be initialized such that proxy 

15 application cannot recognize that further requests 

directed to the TCP socket are now redirected to the new 
XTP socket. Alternatively, prior to determining whether 
XTP or TCP will be used, the requests can be processed in 
parallel using both protocols until a determination is 

20 made. Redirector 914 opens both a TCP and an XTP socket 
and sends communication requests to both sockets. Once 
the protocol is selected, the socket that will not be 
used further is destroyed. 

Figs. 10 and 11 illustrate the detailed operation 

25 of redirector 914 and HTTP Engine 920. A detailed 

description of remote communication server 626 of this 
first embodiment follows the description of module 
operation in gateway computer 612. 

Referring to Fig. 10, redirector 914 responds to a 

30 variety of requests proxy application 613. A request to 
create a TCP socket (1002) is passed to TCP module 916. 
A socket data handle is created by the TCP module and 
passed to the proxy application (step 1004) . 

If the request is to connect (that is, to open for 

35 writing) a TCP socket to a remote computer (1010), the 
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redirector first looks up the TCP socket handle in socket 
association table 915 (step 1011) . If an XTP socket 
handle is associated with the TCP socket handle, the 
request is passed to the software module handling 
5 communication for that TCP socket (step 1013) . If the 
TCP socket handle is not listed in the socket association 
table, the redirector looks up the host address in 
instable 926 (step 1012) . The instable contains the 
addresses of servers that are known to be served by 

10 remote communication servers. If the address is not 

found (step 1014), then the request is forwarded to the 
TCP module (step 1016) . Separately, either during or 
some time after the call to the TCP module, the 
redirector looks up the address in out_table 928 (step 

15 1018) . If the address is found (step 1020) , then the 
addressed host is known to not be served by a remote 
communication server and no more processing is performed. 
If the address is not found in either the instable or the 
out_table, the redirector accesses directory server 640 

20 to update instable and out_table (step 1022) . If the 
address was found in the instable (step 1014) , then a 
remote communication server is servicing requests for the 
addressed host. The next step is to determine whether 
the addressed port on the addressed host is associated 

25 with an HTTP server (step 1024) . This information is 
also stored in instable along with the remote 
communication server address. If the connect request is 
to an HTTP server, a request to create a socket is passed 
to HTTP Engine 920. The HTTP Engine obtains an XTP 

3 0 socket handle from XTP module 956 and returns the socket 
handle to redirector 914 . The redirector records the 
socket handle in socket association table 915 with the 
TCP socket handle used for the request by the proxy 
application, along with an indication that HTTP Engine 

35 920 is now handling requests for that TCP socket. If the 
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addressed host is not an HTTP server; redirector 914 
requests XTP module 956 to create a XTP socket (step 
1027) and the TCP socket handle and the new XTP socket 
handle are recorded in socket association table 915- In 
5 the cases that a XTP socket is created by XTP module 956 
or indirectly by HTTP Engine 920, requests recorded in 
tracing buffer 927 are replayed (step 102 9) to the 
software module (XTP module 956 or HTTP Engine 920) now 
handling communication for the socket. 

10 If the redirector receives a request other than 

one to create or connect a socket (1030) the redirector 
first looks up the TCP socket handle in socket 
association table 915 (step 1031) . If an XTP socket 
handle is associated with the TCP socket handle, the 

15 request is passed to the software module handling 

communication for that TCP socket (step 1032) otherwise 
the request is sent to the TCP module (step 1034) . Note 
that communication between proxy application 613 and 
client application 611 is established by the proxy 

2 0 application issuing a listen request using a TCP socket 

that the proxy application has associated with (bound to) 
a predefined port. This listen is passed to TCP module 
916 according to step 1036. 

Referring to Fig. 11, when HTTP Engine 92 0 
25 receives a request to create an XTP socket to a remote 
communication server in order to service requests for a 
TCP socket to communicate with a server computer (step 
1210) , the HTTP Engine may use an already open XTP 
connection and multiplex communication for the TCP socket 

3 0 on the open connection. If there is no active XTP 

connection to the remote communication server (step 
1212), HTTP Engine 920 requests creation of an XTP socket 
and connects to the remote communication server (step 
1214). When the HTTP Engine receives a write request 
35 (step 1240) , it parses the HTTP content of the request 
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(step 1242) . If the request is to retrieve a remote 
object from the server (step 1244), the HTTP Engine first 
checks to see if the object is already in prefetch 
buffers 984 (step 1246). If it is; the HTTP Engine 
5 records- the association of the TCP socket handle and the 
object requested (step 1248) so that subsequent listen 
and read requests can retrieve the appropriate buffered 
data. If the object is not buffered, the request is 
forwarded over the multiplexed data stream to the remote 

10 communication server (step 1250) . If the write was not a 
request for an object (step 1244) the data is sent to the 
remote communication server (step 1252) . When the HTTP 
Engine receives a request to listen on a connection that 
previously was used to send or record a request (step 

15 1220) , no further processing is necessary. When the HTTP 
Engine receives a request to read (step 123 0) , the object 
previously requested is determined from HTTP context 986. 
If all or some of the object is in prefetch buffer 984, 
that data is provided in response to the read request 

20 (step 1234) . If there is no more data in the prefetch 
buffer (step 1232), for example if the transfer of the 
object was initiated before the request from the client, 
but is still in progress, the HTTP engine requests data 
from the XTP module using the appropriate XTP socket 

25 handle (step 1236) . If the received data is for another 
object (step 1238) , that data is stored in prefetch 
buffer 984 (step 1240), and another XTP read is requested 
(step 1236) . If the received data is for the requested 
object, the data provided in response to the read request 

30 (step 1242) . 

In related embodiments, redirector 914 can also 
. select a transport layer protocol based on other 
criteria. For example, a request to open a TCP 
connection to a port that is associated with a streaming 

35 audio server can be handled using a protocol different 
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from TCP or XTP that is. well suited to the data being 
transferred. For example, a protocol with additional 
forward error correction can be used for streaming audio 
while a protocol with error control which relies on 
5 retransmission can be used for a non-streaming data 
source. The selection criterion can also be based on 
knowledge of the content type of the data. The content 
type can be determined in some cases by monitoring the 
initial portion of the data transmission. 

10 The description above has concentrated on the 

functionality at gateway computer 612 which is part of 
the client communication system. At the server site, 
remote communication server 626 forms the endpoint of 
XTP-based communication with the gateway computer. 

15 Referring again to Fig. 6, remote communication server 
626 acts as a gateway between gateway computer 612 and 
servers 618, 620. Together, remote communication server 
626 and server computers 618, 620 form a single server 
communication system. 

20 Referring to Fig. 12, call handler application 674 

arid communication modules 673 execute on a representative 
remote communication server 626. In the first 
embodiment, remote communication server 626 is a computer 
running a Windows NT or Unix based operating system. A 

25 standard TCP protocol stack including a TCP module 1314, 
an IP module 1316, and a link and data layer module 1318 
are used to communicate to server computers 618, 620. 'An 
XTP module 1320 communicates directly with the IP module. 
Call handler application 674 communicates with 

3 0 communication modules 673 to handle communication between 
a gateway computer and server computers. In addition, 
the HTTP object prefetching function is implemented in 
call handler application 674. 

Call handler application 674 includes a context 

35 handler module 1328 which directs communication between 
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gateway computers and server computers, html parser 1326 
used to interpret html format data passing from a server 
computer to a gateway computer, local table 1322 which ' 
includes information about server computers served by the 
5 remote communication server, and TCP buffers 1324 used to 
hold data passing between server computers and gateway 
computers . 

Context handler 1328 initially creates an XTP 
context and makes a listen request of the XTP module to 

10 accept a connection from a gateway computer. When a 

gateway computer connects an XTP context and requests to 
establish TCP communication with a destination network 
address, context handler 1328 looks up the destination 
network address for a server computer in a local table 

15 1322 and, if it finds the destination network address, . 
initiates an execution thread to handle communication 
with that gateway computer and the server computer. 
There is typically one execution thread per XTP context. 
The execution thread opens a TCP channel to the server 

20 application. A context thread may open multiple 

concurrent TCP channels to one or more server computers 
to handle multiplexed requests from its corresponding 
gateway computer. When, the context handler is notified 
that a listen on a port has been requested by the client, 

25 a TCP listen is requested through TCP module 1314 and 
begins to read data that it buffers in TCP buffer 1324. 

Context handler 1328 can optimally restrict 
connections between client and server computers. In one 
instance, context handler 1328 determines whether 

3 0 accepting a connection request from a client system would 
exceed a total communication capacity for the 
communication server computer. The communication 
capacity can be based on a variety of factors including 
the number of client systems, the number of TCP streams 

35 to server computers, or the maximum total data 
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communication rate as calculated by summing the 
negotiated maximum data rates of all the XTP connections ' 
or as calculated by averaging past actual data rates. If 
the communication capacity would be exceeded by accepting 
5 a connection, the connection is refused and the client 
system must connect to the server computer directly using 
TCP. 

Alternatively, context handler 132 8 can restrict 
connections between client and server computers based on 

10 the server computer identified in the communication 
request from the client computer. For instance, only 
server computers listed in local table 1322 can be 
accessed by a client computer. In this way, the remote 
communication functions as a firewall. 

15 Context handler 1328 is also responsible for the 

server end of the modified HTTP protocol. As a Web (html 
format) page is retrieved from a Web server by a context 
handler through the TCP/IP stack, the page is parsed by 
html parser 1326. References to objects are extracted. 

2 0 The context handler then makes requests for the objects 

on servers also served by the remote communication server 
and forwards the results to the gateway computer which 
stores them in its prefetch buffer anticipating a request 
for them from the client application. Context handler 
25 1328 also includes compression module 132 9 and security 
module 1327 for providing compression and encryption 
services, respectively, for data streams passing between 
the remote communication server and the gateway computer. 

Local table 1322 containing served hosts addresses 

3 0 is periodically communicated to a directory server 64 0 so 

that a gateway computer can locate an appropriate remote 
communication server for a TCP address. A table update 
module 1325 receives information from server computers to 
update local table 1322. For instance, the server 
3 5 computers can periodically send broadcast messages that 
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are received by table update module 1325, or the server 
computers can send a message to the table update module 
when they are initially configured. Alternatively, the 
addresses of the server computers can be entered manually 
5 through a user interface. Local table 1322 can also be 
updated manually through a graphical user interface (GUI) 
1323 coupled to an input/output device 1324. 

XTP module 132 0 includes a rate control module 
1321. Rate control module 1321 limits the total data 

10 rate to each client system rather than limiting the data 
rate of individual XTP connections. The rate limit for a 
particular client system is maximum of the negotiated 
maximum data rates of individual XTP connections to that 
client system. In this way, even if a client system 

15 opens multiple XTP streams, rate control module 1321 
. avoids exceeding the capacity of data links that may be 
shared by the multiple streams. 

In a variant of the first embodiment, software 
modules that are hosted on a communication server 

20 computer and those hosted on a server computer are hosted 
together on a single computer. In this variant, 
communication passing between a call handler application 
and a server application does not flow across a local 
network. Instead, data is sent to communication services 

25 hosted on the single computer, and passed directly to the 
destination application by those communication servers. 

A second embodiment of the invention implements 
the same functionality at the server system from the 
point of view of a client application and the same 

3 0 functionality at the client system from the point of view 
of a server application as in the first embodiment. 
However, in the second embodiment, software modules are 
hosted directly on a client computer or a server ■ 
computer. In addition, since a gateway computer is not 

35 used, no proxy application is needed. The arrangement of 



WO 99/01968 



PCT/US98/11928 



- 53 - 

software modules on a client computer is shown in Fig. 
9a. This arrangement is substantially the same as that 
shown for a proxy computer as shown in Fig. 9 with the 
exception that proxy application 613 is replaced with a 
5 client application 613a. Client application 613a can be 
a browser application which includes a user interface 
module 905 coupled to an input/output device 906 for 
accepting requests for information from a user and 
displaying information sent from server computers in 

10 response to the requests. 

At the server system, in the second embodiment, 
the functionality of the server computer and the remote 
communication server are combined on a single computer 
which uses the Microsoft Windows 95, Windows NT, or Unix 

15 operating system. A server application 1412 configured 
to use TCP and HTTP executes on the server computer. 

Referring to Fig. 13 , the arrangement of software 
modules is similar to that shown in Fig. 9. Server 
application 1412 requests TCP services from layered 

20 communication services 1402. Redirector 1414 handles the 
request and communicates with transport services 1404, 
including TCP module 1416 and XTP module 1456, or HTTP 
Engine 14 60 to handle services requested by server 
application 1412. Redirector maintains a socket 

25 association table 1415 that associates TCP socket handles 
created for the server application and XTP sockets, 
created by the redirector. 

Redirector 1414 initially receives a request from 
server application 1412 to listen on a predefined port 

3 0 for a TCP connection from a client system. Redirector 
1414 determines using local table 1424 whether that port 
corresponds to a server application for which an XTP- 
based connection can also be accepted, and if so, it also 
determines whether the port is a server port for HTTP 

35 based communication. Based on this determination, 
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redirector 1414 either forwards a request to listen only- 
TCP module 1416, or in addition requests either XTP 
module 1456 or HTTP Engine 1460 to also listen for an XTP 
based connection on an XTP socket. If a connection is 
5 received on an XTP-based socket, the association of the 
- TCP socket handle known to the server application and the 
XTP socket handle known to the redirector is recorded in 
socket association table 1415. 

When redirector 1414 receives any other request 

10 using a TCP socket handle, that handle is looked up in 
socket association table 1415 and if found, the request 
is forwarded to the module handling that socket (XTP 
module 1456 or HTTP Engine 1460) otherwise it is sent to 
TCP module 1416. 

15 When HTTP Engine 1460 receives a request to send 

information to a client computer, HTTP Engine multiplexes 
the outbound data using HTTP multiplexor 1482. If the 
data stream corresponds to an html format Web page, the 
information in that page is interpreted in html parser 

20 14 83 and references to embedded data are recorded by HTTP 
context handler 1481. If the referenced data is 
available from server application 1412, HTTP context 
notes that this data should be prefetched from server 
application 1412. 

25 When HTTP Engine 1460 receives a request to listen 

for a connection, that request can be satisfied in three 
different ways. First, if HTTP context handler 1481 has 
previously noted that data should be prefetched from 
server application 1412, a HTTP request is simulated by 

30 HTTP context handler 1481 and the listen is satisfied by 
this simulated request. Second, XTP module 1456 may 
accept a new XTP socket from a new client computer. 
Third, HTTP Multiplexor 1482 may satisfy the request 
using multiplexed communication on a XTP communication 

3 5 channel with a current client computer. HTTP Engine 1460 
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records the association of the TCP socket handle known to 
the server application and the source of the data that 
satisfied the listen request. 

When HTTP Engine 1460 receives a request to read 
5 data, the read is either satisfied by HTTP context 
handler 1481 which simulates a HTTP request, or is 
handled by HTTP multiplexor 1482 depending on how the 
corresponding listen request was handled- Since multiple 
data streams may be multiplexed on a single XTP context, 

10 the read request handled by HTTP multiplexor 1482 is 

either satisfied by previously read data in HTTP buffer 
1484, or by data read from an inbound XTP socket. Data 
read but that is not used to satisfy the read request is 
buffered in HTTP buffer 14 84 until data that does satisfy 

15 the read request is found on the inbound stream. 

In other embodiments, a various types of client 
and server communication systems can be used. Some 
client communication systems can include client computers 
communicating through a gateway computer while other 

2 0 client computers communicate directly to server 
communication systems using XTP. Some server 
communication systems can include one or more remote 
communication servers while others can use server 
computers that include the functionality of a remote 

2 5 communication server. In addition, the functionality 

hosted on a gateway computer in the first embodiment can 
be hosted on a proxy server at a POP such as proxy server 
140 at POP 110b shown in Fig. 1 in which case the client 
communication system is hosted on computers both at the 

3 0 client site and at the POP. In addition, communication 

between a client computer and the proxy server can use a 
variety of protocols, including proprietary protocols 
that are particular to communication between certain 
clients and certain proxy servers. 
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Other embodiments of the invention use alternative 
methods to determine whether communication between a 
client computer and a server computer can use an 
alternative transport layer protocol, and to determine an 
5 alternative network address to which a client computer 
should address such communication using the alternative 
transport layer protocol. One approach is for the 
alternative network address to be a known transformation 
of the network address of the server application itself, 

10 for example, a different port index on the same addressed 
host. In this approach, a gateway computer or a 
specially enabled client computer tries to make a 
connection to a remote communication server (which may 
not exist) and if there is no response, assumes that the 

15 server computer is not served by a remote communication 
server and, instead, proceeds to establish a TCP 
connection. 

Referring to Fig. 14, a third illustrative 
embodiment makes use of directory information which is 

20 distributed, in part, at server computers themselves. A 
client computer uses this distributed information to 
determine whether a server computer can accept 
communication using an alternative communication protocol 
at an alternative address. In Fig. 14, server computer 

25 1410 is associated with a remote communication server 
1420 which receives communication for server computer 
1410 at an alternative address using the alternative 
communication protocol. Note that in. related 
embodiments, the functionality of remote communication 

30 server 1420 and server computer 1410 could be provided by 
a single computer, and in such embodiments the 
alternative address is then on the same host as an 
originally requested TCP address. 

Remote communication server 142 0 is coupled to one 

35 or more server computers 1410 over LAN 1430 which is in 
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turn coupled to a client computer 1451 over Internet 
1440. Client computer 1451 includes a processor 1453, 
non-volatile data storage 1457, such as a magnetic disk, 
and program storage 1454, such as a fixed or removable 
5 disk. A communication interface 1459 couples processor 
1453 to Internet 1440. Server computer 1410 similarly 
has a processor 1413, non- volatile data storage 1416, 
program storage 1414 and a communication interface. Also 
coupled to Internet 1440 is a list server 1462, which 

10 serves a similar function to the directory servers 
described in the first and second embodiments. List 
server 14 62 includes a non- volatile data storage such as 
a magnetic disk. 

Also coupled to Internet 1440 is a domain name 

15 service (DNS) 1470 that provides a name resolution 
service for other computers coupled to it over the 
Internet. DNS 1470 can accept a host name and provide an 
IP address associated with that host name. List server 
1462, also coupled to Internet 1440, maintains a database 

2 0 including associations of server computers and IP 

addresses of remote communication servers associated with 
those server computers. This database is stored on non- 
volatile storage 1461. 

Referring to Fig. 15, when a client application 
25 1510, such as a Web browser, executing on client computer 
1451 (Fig. 14) attempts to communicate using TCP/IP with 
an IP address on server computer 1410 (Fig. 14), 
communication passes through a set of software modules 
also executing on client computer 1451. Fig. 15 shows an 

3 0 arrangement of software modules for a client computer 

using the Microsoft Windows95 or Windows NT operating 
systems . 

Client application 1510 communicates with a 
Winsock2 module 1520 which provides an interface to 
35 communication services, including TCP/IP services needed 
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to communicate with remote computers. Winsock2 1520 
includes interfaces to name service providers and to 
transport service providers. A name service provider is 
a software module that translates host names, in the form 
5 of character strings, into a lower-level address that are 
then used by transport service providers, such as a TCP 
service provider. A name service provider may rely on 
services provided by another computer, such as an 
Internet DNS. A transport service provider is a software 

10 module that implements transport layer communication 
services to allow a client application to communicate 
with remote applications. In Fig. 15, layered service 
module (LSM) 1540 provides standard transport protocol 
services, such as TCP-based transport services, to 

15 Winsock2 1520 according to the Microsoft Winsock2 Service 
Provider Interface (SPI) and therefore behaves as a 
transport service provider. Directory module 1550 
provides IP-based name services to Winsock2 1520. 
Together, directory module 1550 and layered service 

2 0 module 1540 are part of a redirect or 153 0 which 

determines whether an alternative communication protocol 
can be used on a particular TCP/IP connection request 
from client application 1510 to a server computer, and 
provides an interface to transport services 1590 used to 

25 pass data to and from that server computer. Raw IP 
module 1595, in turn provides lower-level services to 
modules in transport services 1590. Transport services 
1590 also provides communication services to directory 
module 1550. A user interface (UI) application 1535 is 

30 also coupled to directory module 1550. UI application 
1535 provides an interface to a user of the client 
computer to access information maintained in directory 
module 1550, and to update that information. 

Referring to Fig. 16, transport services 1590 

35 include TCP module 1660 and XTP module 1662, which 
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provide transport services directly to LSM 1540. As in 
the previously described embodiments, XTP module 1662 is 
used to provide transport layer communication services 
for enhanced communication between a client application 
5 1510 and a remote server application. 

Continuing to refer to Fig. 16, directory module 
1550 includes several submodules. A name resolution 
service 1650 receives name resolution requests from 
Winsock2 1520 and uses a database 1620 to attempt to 

10 resolve those requests. A directory manager 1610 

receives requests from LSM 1540 to determine whether a 
remote communication server is associated with the 
address of a server computer. Directory manager 1610 
uses database 1620 and possibly a network lookup module 

15 164 0 in responding to those requests. 

Database 1620 includes an address database 1624 
which includes associations of server host names, server 
IP addresses, and IP address of remote communication 
servers, if any, associated with those server hosts. 

2 0 Address database 1624 also includes additional 

information particular to specific server sites. Address 
database 1624 is maintained on non-volatile data storage 
1457 (Fig. 14) using multiple files. In addition, 
database 1620 includes a memory cache 1622, stored in 
25 volatile working storage 1458 (Fig. 14), used to maintain 
copies of portions of the database: for rapid access. 
Database 1620 also includes ageing information 1629 which 
is used to record information related to data access and 
is used to delete data, for example, data that was least 

3 0 recently accessed or has been least frequently accessed, 

in order to free space on working storage 1458 or non- 
volatile storage 1457. 

Address database 1624 is stored on non-volatile 
storage 1457 using a separate binary file for each server 
3 5 computer. Referring to Fig. 17a, for a particular 
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server, the file contains binary fields delimited by 
field separators 1795. The fields in a record include 
the IP address of a remote communication server (SS_IP) 
1770, and a name entry for the server computer (WS_NAME) 
5 1780. The record also includes site-specific information 
(SITE_INFO) 1790. Each of the individual files of 
address database 1624 are stored in a single directory, 
and have file names derived from the IP address of the 
server computer (WSJEP) , In particular, the WS_IP field 

10 is interpreted as a unsigned 32 -bit number, and expressed 
in base 36 using the symbols 0-9 and A-Z. A common 
prefix, for example "SN", and a common extension, for 
example, 11 .SSF", is used for all the files. For example, 
the IP address 11 199. 103. 141. 58" is associated with the 

15 filename "SNG8V2RR. SSF" . 

Referring again to Fig. 16, directory manager 1610 
makes use of network lookup module 1640 to access 
distributed directory information that it uses to 
determine whether a remote communication server is 

20 associated with the address of a server computer. If, in 
response to a request from LSM 1540, directory manager 
1610 cannot satisfy a request for remote communication 
server information using database 1620 alone, the 
directory manager issues a request to network lookup 

25 1640. Network lookup 1640 uses path resolver 1642 and 
web server access 1646 modules, which in turn uses 
transport services 1590, to attempt to retrieve the 
needed information from the server computer itself. If 
successful, network lookup 1640 provides the retrieved 

30 remote communication server information to directory 
manager 1610, which then both updates database 162 0 and 
provides a response to LSM 154 0. 

UI application 1535 is also coupled to directory 
manager 1610. UI application 1535 provides an interface 

35 for a user of the client computer to access information 
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in database 1620, and to update that information. A 
user may update information in database 1620 by 
explicitly providing that information to UI application 
1535. For example, a user may know the address of a 
5 remote communication server associated with a particular 
server computer. The user may also know information 
needed to establish a connection to the remote 
communication server, such as a password, that he 
provides to the UI application for storage in database 
10 1620. 

Rather than explicitly providing information for 
database 1620, the user can also request that information 
be obtained from a server computer 1410 or from a list 
server computer 1462 (Fig. 14) . UI application 1535 

15 requests from directory manager 1610 that a particular 
server computer or list server, or a default list server 
known to directory manager 1610, be accessed to obtain 
information to be stored in database 1620. An explicit 
location on the list server may be provided by UI 

20 application 1535, or a default location known to 

directory manager 1610 may be used. Directory manager 
1610 passes the request to path resolver 1642, which uses 
list server access module 1644 to retrieve the 
information from a list server, or which uses web server 

25 access 1646 module to retrieve the information from a 
server computer. The information is passed back to 
directory manager 1610 which uses the information to 
populate database 1620. 

The user may also use UI application 1535 to 

30 access information in database 1620. For example, site 
descriptions of server computers, lists of server 
computers in a particular category, or other information 
about the servers can be displayed. This information may 
be used by the user to select a particular server 

35 computer. 



WO 99/01968 



PCT/US98/11928 



- 62 - 

Network lookup 1640 accesses data on a server 
computer, or on a list server, by retrieving a data file 
from that computer. Web server access 1646 uses a 
predetermined pathname for the data file on the server 
5 computer. The data file is known as a "site file." The 
file is kept in a secret directory that is not normally 
accessible to remote users. In this embodiment, the 
pathname is of the form 

" <WEBROOT>/<DIRNAME>/<FILENAME> . dat 11 , for example 

10 n <WEBROOT>/.sitara/ sitara.dat", where !t <WEBROOT>" is the 
pathname of the root directory accessed by a Web server. 
List server access 1644 by default uses the same file 
name when retrieving information, although an explicit * 
path name may be provided by the user through UI 

15 application 1535. 

A site file includes information used to populate 
database 1620. In this embodiment, the site file is a 
text file. Referring to Fig. 17b, the site file has one 
or more lines as shown. Each line, associated with a 

20 particular server computer, contains tab delimiters 1710 
separating the IP address of the server computer (WS__IP) 
1730, the IP address of a remote communication server 
(SS_IP) 174 0, which is a null entry if there is no remote 
communication server associated with the server computer, 

25 and a name entry for the server computer (WS_NAME) 1750. 
The record also includes site- specif ic information 
(SITE_INFO) 1760, and is terminated by a newline 1720. A 
site file, both on a server computer and on a list 
server, may have multiple lines corresponding to multiple 

3 0 associations of server computers with remote 
communication servers. 

Operation of various software modules is 
illustrated in the flowcharts in Figs. 18-22. In the 
following description of the flowcharts, unless otherwise 

35 indicated in parentheses, elements involved in the steps 
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appear in Fig. 16. A request by client application 1510 
to Winsock2 1520 to connect a TCP socket (communication 
channel) to the server computer is handled in several 
steps. 

5 Referring to Fig. 18, after client application 

1510 provides the name of the server computer in the form 
of a character string, V?insock2 1520 determines an IP 
address associated with this host name. Winsock2 1520 
later passes that IP address to transport services that 

10 actually connect the communication channel. In 

determining the IP address, Winsock2 152 0 first requests 
resolution of the server host name from name resolution 
module 1650 (step 1810) . If name resolution module 1650 
cannot find an IP address for the host (step 1812), 

15 Winsock2 1520 requests resolution of the host name from a 
default name service provider (step 1920) which accesses 
DNS 1470 (Fig. 14) to resolve the server host name. If 
name resolution module 1650 cannot provide the IP address 
(step 1812) and DNS 1470 cannot provide an IP address for 

2 0 the server host (step 1822) , Winsock2 1520 reports a name 
lookup failure to client application 1510 (step 1824) . 

Assuming that Winsock2 152 0 successfully resolves 
the server host name, using either name resolution 
service 1650 or DNS 1470, it then requests that LSM 1540 

2 5 connect the socket to the IP address of the server 

computer (WS_IP) . 

Referring to Fig. 19, LSM 1540 receives a request 
to connect to a server at address WS_IP. LSM 1540 
requests from directory manager 1610 the address of a 

3 0 remote communication server associated with the server 

computer's IP address (step 1920). Directory manager 
1610 accesses database 1620 by first searching memory 
cache 1622 and, if no record is found, searching address 
database 1624. If it finds a record for the server 
3 5 computer, it returns the value of the SS_IP field, which 
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is the address of a remote communication server for the 
server computer. If the record was found in address 
database 1624, directory manger 1610 stores a copy of the 
record in memory cache 1622. If there is no record for 
5 the server computer in database 1620 , directory manager 
1610 returns a null address. If directory manager 1610 
returns a null remote communication server address (step 
1922) , LSM 154 0 attempts to connect to the server 
computer directly using TCP (step 1910) . If directory 

10 manager 1610 returns the address of a communication 
server, LSM 1540 connects to the remote communication 
server using the appropriate enhanced communication 
protocol (step 1926) . In particular, the enhanced 
protocol involves communication using XTP module 1662 in . 

15 a manner presented above in the descriptions of the first 
and second embodiments. If LSM 1540 connects to the 
server computer using TCP (step 1910) , it subsequently 
issues a request to directory manager 1610 to update its 
entry for that server computer (step 1915) . 

20 Referring to the flowchart of Fig. 20, when LSM 

1540 requests from directory manager 1610 that it update 
the entry for a server computer, directory manager 1610 
first determines whether a record for the server computer 
is stored in database 1620 (step 2010) . If there is a 

25 record, directory manager 1610 does not need to perform 
any further update. If directory manager 1610 determines 
that there is no record in address database 1620 
associated with the server IP address (step 2010) , it 
attempts to obtain a site file from the server computer 

30 (step 2020) . Directory manager 1610 requests the site 

file information from network lookup 1640 (Fig. 16) which 
accesses the site file from the server computer at 
address WS_IP, in this embodiment, using the HTTP 
protocol. If network lookup 1640 successfully returns 

35 the information in the site file (step 2022), directory 
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manager 1610 updates both memory cache 1622 and address 
database 1624 of database 1610 (step 2024) . If the site 
file is not successfully retrieved (step 2022), for 
instance because the server computer is not associated 
5 with a remote communication server in which case the 
server computer returns a "file not found" message when 
the client computer requests the site file, directory 
manager 1610 updates memory cache 1622 (but not address 
database 1624) of database 1620 by creating a record for 

10 the server computer, and storing a null in the field for 
the remote communication server address associated with 
the server address (step 2026) . Note that memory cache 
1622 is deleted when client application 1510 exits, and 
therefore a record which indicates that a server computer 

15 is not associated with a remote communication server 
persists only as long as the application that accessed 
the server computer is active. 

A fourth embodiment extends the functionality of 
the third embodiment, described above, to include 

20 loadable software modules for use in communication with 
particular remote communication servers. Referring back 
to Fig. 17, the SITE_INFO field of a record of database 
162 0 can now include a reference to a loadable software 
module that is required for communicating with the remote 

25 communication server at address SS_IP. A reference 

includes a URL of the software module. Directory manager 
1610 is responsible for retrieving and keeping the 
software module up to date. LSM 1540 is responsible for 
dynamically loading the module, and for branching to 

3 0 available entry points in the module at appropriate times 
while communicating with the remote communication server. 
A loadable module is kept up to date using a trigger 
mechanism. Specifically, for each loadable module that 
has previously been retrieved, directory manager 1610 

35 maintains records the latest date the module was 
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retrieved or that it checked to determine whether a newer 
version was available. Each loadable module is also 
associated with a maximum interval that the module can be 
used before directory manager 1610 must check that a 
5 newer version is available. If more than the maximum 
interval for a module has elapsed since the module was 
loaded or a check was made, directory manager 1610 checks 
whether a newer version is available, and if one is 
available, the newer version is retrieved by directory 

10 manager 1610 and loaded by LSM 1540 without the necessity 
of user intervention. 

Referring to Fig. 21, after directory manager 1610 
retrieves a record from database 1610, or from a newly 
retrieved site file, (step 2110) , directory manager 1610 

15 determines from the SITE_INFO field whether a loadable 
module is required for communication with the indicated 
remote communication server (step 2112) . If a loadable 
modules is not needed, the remote communication server IP 
address is returned to LSM 1540 as in the third 

20 embodiment. If a loadable modules is required (step 
2112), then directory manager 1610 determines whether it 
is currently storing a local copy of the required module 
(step 2114) . If not, the directory manager retrieves the 
module (step 2120) and stores it in a local file. The IP 

2 5 address of the remote communication server and the 

pathname of a local copy of the retrieved module are 
returned to LSM 154 0. If the module has been previously 
retrieved (step 2114), then it may have already expired. 
Expiration is checked (step 2116) , and if it the module' 

3 0 has not expired, then the IP address of the communication 

server and the local pathname of the loadable module are 
passed to LSM 1540. If, on the other hand, the module 
has expired (step 2116), directory manager 1610 checks 
whether a newer version is available by accessing the 
3 5 date of the version at the referenced location over the 
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Internet (step 2118) . If a newer version is available, 
that version is retrieved and stored in a local file 
(step 2120) . The IP address of the communication server 
and the local pathname of the loadable software module 
5 are then passed to LSM 1540. 

Referring to Fig. 22, LSM 1540 includes basic 
layered services 222 0 and possibly one or more loaded 
modules 2230. In this embodiment, which is implemented 
using the Windows95 or Windows NT operating system, a 

10 loadable software module is a Dynamically Linked Library 
(DLL) . When LSM 1540 receives a local pathname of a 
loadable module, that is, the pathname of a DLL, LSM 1540 
loads the DLL. The DLL uses an agreed-upon API, and 
includes a module descriptor which allows basic layered 

15 services 2220 to determine what routines that DLL 

provides. The module descriptor is also used to allow 
proper chaining of modules if more than one routine needs 
to be used in sequence. For example, a decompression 
routine and a decryption routine both may need to be used 

2 0 on an inbound data stream, and the order of applying 

those routines is significant to their proper operation. 
Using the module descriptor, LSM 154 0 determines under 
what circumstances a routine in the loadable module 
should be invoked. 

25 Use of such a loadable module can be understood by 

an example in which the module is used for decompression 
of data flowing from the communication server to the 
client computer. In this case, loadable module 2230 
associated with the communication server includes an 

30 entry point used to filter an incoming data stream. Each 
input buffer read by basic layered services 2220 from 
transport services 1590 is passed to the inbound 
filtering routine in loadable modules 2230. The result 
of applying the routine is then passed to Winsock2 1520 

35 and then to client application 1510. Entry points can 
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also be associated with and invoked by LSM 1540 in a 
variety of situations, for instance, when connecting, 
closing, reading from, and writing to a socket. 

Referring still to Fig. 22, loadable modules 
5 communicate with basic layered services 2220. In the 
example introduced above in which a loadable module is 
used for decompression of data, compressed data received 
by the client computer is passed from basic layered 
services 2220 to loadable module 223 0, where it is 

10 decompressed, and decompressed data is passed back from 
loadable module 2230 to basic layered services 2220. The 
decompressed data is then sent to client application 
1510. Similar data flow is used for a loadable module 
that provides decryption routines. 

15 . A loadable module may also communicate directly 

with transport services 1590. For example, a loadable 
module may multiplex multiple socket connections over a 
single TCP connection. In this case, basic layered 
services 222 0 would provide outbound data to loadable 

2 0 module 223 0, and loadable module 2230 would provide that 

data, after multiplexing it with data from other 
connections, to TCP module 1660. 

A loadable module may also essentially implement 
a transport service, for instance, if a proprietary 
25 transport layer protocol is used with a particular server 
computer. Such a protocol may be used, for example, to 
provide streaming audio data in an efficient manner. In 
this case, a loadable module 223 0 communicates directly 
with Raw IP 1595. 

3 0 A loadable module may also communicate with an 

application interface 2210 which is a separate 
application from client application 1510 which initiated 
the connection. In this way, a customized client server 
application may be initiated. For example, a customized 
35 user interface, particular to a server computer, can be 
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launched by a loadable module. The loadable module then 
provides an interface for application interface 2210 and 
communication services needed by application interface. 
The description of the third and fourth 
5 embodiments referred to a single database entry in 
database 1620 being associated with a server computer. 
Several remote communication server computers may in fact 
be associated with a particular server computer. In this 
case, the file in address database 1622 associated with 

10 that server computer will have multiple records of the 
format shown in Fig. 17b. In the third embodiment, 
directory manager 1610 implements a selection of which 
communication server address to provide to LSM 1540. For 
instance, directory manager 1610 may implement a round - 

15 robin scheme in which each request by LSM 154 0 to connect 
to the server computer results in a different remote 
communication server being used than in the previous 
connection. Directory manager 1610 may also implement 
another selection method, for example based on other 

20 information recorded in the site information field of the 
database. For instance, the site information field may 
indicate that one remote communication server is 
appropriate for clients with a high data rate connection 
to the remote communication server, while another 

25 communication server is appropriate for clients with slow 
or high-latency connections. 

Also in the description of the third and fourth 
embodiments, the system was described in terms of a local 
computer establishing an enhanced communication path to a 

30 server computer. In the first two embodiments, an 

enhanced communication path used an enhanced transport 
layer protocol, that is the XTP protocol, or multiplexing 
of socket connections from a client application using a 
single TCP or XTP. In the third and fourth embodiments, 

35 communication between a local computer and a remote 
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server may be enhanced in a wide variety of ways, not 
necessarily involving transport layer communication 
protocols. For example, application layer enhancements 
to the communication between the client computer and the 
5 remote computer may be used. For instance, if a server 
computer supports a catalog shopping service, 
communication passing between the local computer and the 
server computer may involve relatively low level data 
requests, for example for product descriptions, prices, 

10 etc. The user, however, may be presented a full-featured 
user interface within a standard Web browser. Software 
in the layered service module, or in a loadable module, 
provides the interface between the Web browser and the 
low level communication passed between the client 

15 computer and the server computer. Other enhanced 

communication approached implemented at various layers, 
from the data link layer to the application layer, may be 
used in the described, or related, embodiments. 

In the fourth embodiment, if multiple remote 

20 communication servers are available for a server 

computer, the entire list is provided to LSM 1540. A 
loadable module is then be used to select the appropriate 
communication server for each connection. 

Also in the fourth embodiment, other forms of 

25 loadable modules may be used. For instance, rather than 
DLLs, Java applets may be used. 

In the third and fourth embodiments, database 1620 
is implemented using text files stored on the client 
computer's file system to store database records and 

3 0 loadable software modules. An object database may 

alternatively be used. For instance, each record may be 
stored as a binary file including a tag and length for 
each field, multiple records may be stored in a single 
file, or relational tables may be used. Furthermore, if 

3 5 loadable software modules are used, database 162 0 may be 
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used to store the modules themselves, rather than using 
the local computer's file system. 

Also in the third and fourth embodiments, use of 
the cooperating name resolution service 1650 and layered 
5 service module 1540 allows a client application to use 
host names that would not be resolved by an Internet DNS. 
For instance, referring to Fig. 15, a "friendly" name can 
be passed from client application 1510 to Winsock2 1520. 
The friendly name is passed to directory module 1550 
10 which returns a data structure which includes the address 
in the form needed by the appropriate transport services. 

An alternative approach to determining whether a 
server computer can be accessed through a remote 
communication server involves a client computer (or proxy 
15 computer) initially retrieving information from a server 
computer using TCP. Then, based on application layer 
data transferred over the TCP connection, the client 
computer determines the address of a remote communication 
server. In the case of http-based data connections, the 

2 0 address of the remote communication server is provided as 

part of the response to a HTTP request. The server 
address can be embedded in the stored files on the server 
computer, thereby being provided to the client computer 
as part of a normal retrieval of data by a standard Web 
25 server application. Alternatively, the remote 

communication server address can be added by the Web 
server application prior to sending a response to the 
client. If the client receives a remote communication 
server address in the data, it updates its local tables 

3 0 and uses the remote communication server for subsequent 

communication with the server computer. 

Referring to Fig. 23, in an alternative 
arrangement, remote communication servers 2340 can be 
used to balance load on a set of server computer in 
35 conjunction with a network address translator (NAT) 2310. 
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NAT 2310 is connected between the Internet and a LAN 
2350. Network addresses of computers on LAN 2350 are not 
necessarily known to computers, such as client computers, 
on the Internet. In order to communicate with a computer 
5 on LAN 2350, a computer on the Internet directs 

communication to a network address to which NAT 2310 
responds and NAT 2310 forwards communication between the 
computer on the Internet and the computer on LAN 2350. 
Internally, NAT 2310 maintains an address association 

10 table 2312 which maps Internet network addresses to local 
network addresses which are valid on LAN 2350. In the 
simplest case, the table has a one-to-one correspondence 
between Internet network addresses and local network 
addresses. Address association table 2312 can also have 

15 multiple local network addresses associated with a single 
Internet network address. In this case, NAT 2310 chooses 
one of the multiple local network addresses to match to 
the Internet network address when it receives 
communication from a remote computer. For example, NAT 

20 2310 can use a round- robin selection approach to choose a 
particular local network address. NAT 2310 can therefore 
balance the load of requests to communicate with a single 
Internet network address by passing different requests to 
different computers on LAN 2350. Once NAT 2350 has 

25 connected a remote computer on the Internet to a 
particular local computer on LAN 2350, it connects 
subsequent requests from that remote computer to the same 
local computer on LAN 2350 until a minimum time has 
elapsed since the remote computer has closed all its 

3 0 communication paths to the local computer. 

Referring still to Fig. 23, LAN 2350 couples two 
or more remote communication servers 234 0 and two or more 
server computers 2330 to NAT 2310. Server computers 2330 
share a common network address and remote communication 

35 servers 2340 share anther network address. Requests from 
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a client system to communicate directly with a server 
computer 2330 are handled by NAT 2310 in the manner 
described above. Requests from a client system to 
communicate with a remote communication server are also 
5 handled by NAT 2340. NAT 2340 handles these requests by 
choosing one of the remote communication servers 2340 and 
passing communication between the client system and the 
remote communication server. This communication includes 
the XTP communication over which the client system sends 

10 requests to communicate with server computers. 

When a remote communication server 2340 receives a 
requests to communicate with a server computer, the 
request identifies the server computer using a network 
address that would be valid from the Internet, that is, 

15 using an address that would be translated by NAT 234 0 if 
the client system were to try to contact the server 
computer directly. Therefore, remote communication 
server maintains a server association table 2342 
containing the Internet network address for the server 

20 computers associated with their local network addresses. 
When remote communication server 2340 receives a requests 
to communicate with a server with a particular Internet 
network address, the remote communication server accesses 
its server association table to determine whether it 

25 provides communication services for that server computer 
and, if so, to determine a local network addresses 
correspond to that server. Server association table 2342 
also includes a record of the particular server computers 
matched to requests from particular client systems in 

3 0 order that the same server computer can be uses for a 
series of requests to communicate. 

In the arrangement shown in Fig. 23, address 
translation therefore occurs at two levels. First, NAT 
2310 translates an Internet network address for a remote 

35 communication server into one of the local network 
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addresses of remote communication servers. Then, when a 
client requests to communicate with a server computer, 
the remote communication server translates the Internet 
network address of the requested server computer into one 
5 of the local addresses of the server computers on the 
LAN. 

Other combinations of elements described in the 
above embodiments may alternatively be used. For 
instance, the first embodiment uses a client computer 

10 which accesses the Internet through a gateway computer. 
Other described embodiments combine the functionality of 
the client computer and the gateway computer into a 
single computer. In embodiments that combine the 
functions, separate computers could equivalently be used. 

15 Similarly, the functions of a remote communication server 
and a server computer may be hosted on separate 
computers, or hosted on a single computer. If their 
function is hosted on a single computer, the 
communication passing between the remote communication 

2 0 server and the server computer does not have to pass over 

a data network. 

In the described embodiments, information related 
to a server computer, and in particular information 
associating a server computer with a remote communication 
25 server, is stored in some combination of a directory 

server, a list server, or on the server computer itself. 
Other storage locations for the information may 
equivalently be used. For example, information related 
to loadable modules may be stored on a centralized 

3 0 directory server. Also, the function of a DNS may be 

extended so that, in addition to providing a translation 
of a host name to its associated IP address, additional 
information, including an address of a remote 
communication server, may be provided. In the case that 
3 5 additional information is stored on the DNS computers and 
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retrieved along with the IP address of a server computer, 
there is no explicit request for the information. The 
additional information is provided in response to the 
request for the server computer's IP address. The 
5 address of a remote communication server associated with 
a server computer may also be provided without an 
explicit request in other situations. For example, the 
information may be provided in the header of information 
retrieved from a server computer. If the server computer 

10 is a Web server, the address of a remote communication 
server associated with it may be provided in the header 
of HTML documents retrieved from the server. The client 
computer is then responsible for detecting and extracting 
the information from those HTML documents as they are 

15 passed to an application. 

If the function of a remote communication server 
and a server computer are combined on a single computer, 
the host portion of the address of a server computer and 
the remote communication server would, in general, be the 

20 same. Communication can be delivered to the system on 
the single computer by using different port indices for 
the function of the server computer and the function of 
the remote communication server. Alternatively, or in 
addition to, using a different port index., communication 

25 from the client computer to the server computer can use a 
different protocol index than communication from the 
client computer to the remote communication server. 
Communication can be routed to the appropriate system on 
the single computer based on the protocol index. 

3 0 In the above embodiments, there may be some remote 

communication servers that do not advertise their address 
in a directory server, in a list server, or in a site 
file. For example, access to a particular remote 
communication server may be limited to. particular 

3 5 subscribers of a service while others use the standard 
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TCP interface. In such a case, a manual entry of the 
remote communication server information may be possible. 
Also, in the cases that a directory server is used, 
requests from a gateway computer may be batched and 

5 communication between a gateway computer and a directory 
server can occur less frequently thereby reducing the 
load on the directory server. 

In other related embodiments, multiple alternative 
protocols can be supported. Instead of passing all non- 
10 TCP communication through an XTP module, a matrix switch 
feeding multiple protocol modules can be used. The 
redirector then also determines which protocol module to 
use. Software modules, including the "hook," the 
redirector, or the HTTP Engine, may be incorporated into 

15 a layered Winsock protocol under the Windows 95 or 
Windows NT operating system. 

Additional application protocol spoofing can be 
performed. For example, an FTP module can be inserted 
between a redirector and the XTP module to spoof FTP 

20 communication in the same way that a HTTP Engine is used 
to spoof the HTTP application protocol. Various 
techniques may be used to initialize a socket using an 
alternative protocol. Rather than recording requests in 
a tracing buffer, the socket may be initialized directly 

25 into a desired state. 

In addition to adding alternative transport 
protocols which use IP, replacing the IP layer as well 
may be feasible in some situations. For example, if IP 
is layered on an ATM network, both TCP and IP can be 

30 bypassed in a similar arrangement to that used to bypass 
TCP in the described embodiments. 

Embodiments of this invention can make use of 
multiple TCP segments rather than using XTP or some other 
alternative transport protocol. In such embodiments, 

35 application protocol spoofing, multiplexing, and server 
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site s aggregation (service of multiple server computers 
using a single remote communication server) can be used 
over TCP channels. In addition, the parameters of the 
TCP connections on different segments may be different 
5 resulting in improved end-to-end characteristics. 
Other embodiments may address channel 
characteristics other than throughput and latency, or 
address throughput and latency using different types of 
communication techniques. For example, achieving low 

10 latency over high capacity but high delay channels may be 
best be achieved by using an alternative transport 
protocol that makes use of forward error correction 
rather than error detection and retransmission. In 
addition, the alternative protocols can be used to 

15 control a quality of service on certain data streams 
while still allowing the application to use TCP without 
modification. 

Software used to implement various components of 
the invention may be stored on a variety of computer 

20 readable media, including fixed or removable magnetic or 
optical disks. Alternatively, it may be stored remotely 
from the computer on which the modules execute, and 
accessed using a data network. 

It is to be understood that while the invention 

25 has been described in conjunction with the detailed 
description thereof, the foregoing description is 
intended to illustrate and not limit the scope of the 
invention, which is defined by the scope of the appended 
claims. Other aspects, advantages, and modifications are 

3 0 within the scope of the following claims. 
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What is claimed is: 

1. A communication system comprising a client 
communication system coupled to a data network for 
communicating with a plurality of server communication 
5 systems each configured to communicate with the client 
communication system using at least one of a plurality of 
transport layer protocols, wherein the client 
communication system includes: 

a transport layer module implementing the 
10 plurality of transport layer protocols for communicating 
with the server communication systems; and 

a layered communication module coupled to the 
transport layer module and including a protocol selector 
for receiving a request to communicate with a requested 
15 one of the plurality of server communication systems and, 
using the request to communicate, choosing one the 
plurality of transport layer protocols for communication 
with the requested server system. 

2 . The communication system of claim 1 wherein 
20 the client communication system further includes an 

application coupled to the layered communication module. 

3. The communication system of claim 2 wherein . 
the client communication system includes a client 
computer programmed to implement the transport layer 

25 module, the layered communication module, and the 
application. 

4 . The communication system of claim 2 wherein 
the application includes a user interface module for 

. accepting from a user requests to communicate with server 
3 0 communication systems and for presenting to the user 
information sent from the server communication system. 
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5. The communication system of claim 2 wherein 
the application includes a server module coupled to a 
plurality of client applications over a local data 
network for accepting requests from the client 

5 applications to communicate with server communication 
systems and for passing information between the server 
communication systems and the client modules. 

6. The communication system of claim 5 wherein 
the client communication system further includes a proxy 

10 computer coupled to the local data network and programmed 
to implement the transport layer module, the layered 
communication module, and the application. 

7 . The communication system of claim 5 wherein 
the client communication system further includes a client 

15 computer coupled to the local data network and programmed 
to implement at least one of the client applications. 

8. The system of claim 7 wherein the client 
communication system further includes a second client 
computer coupled to the proxy computer over the local 

20 data network and programmed to implement another of the 
client applications. 

9. The communication system of claim 1 wherein 
the client communication system further includes an 
application including the layered communication module. 

25 10. The communication system of claim 1 wherein 

the client communication system further includes a server 
table coupled to the protocol selector of the layered 
communication module for holding information related to 
the transport layer protocols with which zero or more of 
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the server communication systems are configured to 
communicate. 

11. The communication system of claim 10 wherein 
the server table includes a first table for holding 
5 information associating identifications of server 

communication systems and information related to one or 
more of the transport layer protocols that the client 
communication system can use to communicate with each of 
the identified server communication systems. 

10 12. The communication system of claim 11 wherein 

the information related to the transport layer protocols 
includes an address of a communication server computer in 
the server communication system coupled to the data 
network for communicating with the identified server 

15 communication system. 

13. The communication system of claim 11 wherein 
the server table further includes a second table for 
holding information associating identifications of server 
communication systems and identifying one or more 
2 0 transport layer protocols with which the identified 
server communication systems are not configured to 
communicate . 



14 . The communication system of claim 10 wherein 
the client communication system further includes a table 

25 interface module for providing a user interface for 
viewing and modifying information in the server table. 

15. The communication system of claim 10 wherein 
the information related to the transport layer protocols 
includes information related to an expiration time after 
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which some of the information related to the transport 
layer protocols is not longer valid. 

16. The communication system of claim 1 wherein 
the transport layer module includes a rate control module 

5 for negotiating a maximum rate of data transmission with 
server communication systems. 

17. The communication system of claim 1 wherein 
the layered communication module includes a data 
compression and decompression module for compressing and 

10 decompressing data communicated using at least one of the 
transport layer protocols. 

18. The communication system of claim 1 wherein 
the layered communication module includes a security 
module for encrypting and decrypting data communicated 

15 using at least one of the transport layer protocols. 

19. The system of claim 1 wherein at least one of 
the transport layer protocols supports selective 
retransmission and at least one other of the transport 
layer protocols does not support selective 

2 0 ret r an smi s s i on . 

20. The system of claim 1 wherein the -layered 
communication module further includes a multiplexor and a 
demultiplexer for combining a number of data streams 
associated with separate requests to communicate with 

25 server communication systems into a smaller number of 
transport layer data streams for communicating, with the 
server communication systems. 

21. The communication system of claim 1 wherein 
the client communication system further includes a 
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directory service module coupled to the protocol selector 
of the layered communication module for accessing over 
the data network information related to the transport 
layer protocols with which server communication systems 
5 are configured to communicate. 

22. A communication system comprising a server 
communication system coupled over a data communication 
network to a plurality of client communication systems, 
the server communication system including: 

10 a transport layer module for communicating with 

the client communication systems and one or more server 
applications; and 

a communication application coupled to the . 
transport layer module for maintaining a transport layer 

15 communication stream with each of a number of client 
communication systems, for accepting requests over the 
communication streams from client communication systems 
to communicate with the one or more server applications, 
and for passing information between the client 

20 communication systems and the server applications over 
the communication streams. 

23 . The communication system of claim 22 wherein 
the server communication system further includes a 
communication server computer coupled to the data 

25 communication network and programmed to implement the 

transport layer module and the communication application. 

24. The communication system of claim 23 wherein 
the communication server computer is further programmed 
to implement at least one of the server applications. 

30 25. The communication system of claim 23 wherein 

the server communication system further includes an 
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application server computer programmed to implement at 
least one of the server applications and a local data 
network coupling the communication server computer and 
the application server computer. 

5 26. The communication system of claim 22 wherein 

the transport layer module implements a plurality of 
, transport layer protocols, and wherein the communication 
application is configured to communicate with the server 
applications using a first of the transport layer 
10 protocols and to communicate with client communication 
- systems using a second of the transport layer protocols. 

27. The communication system of claim 26 wherein 
the second transport layer protocol supports selective 
retransmission and the first transport layer protocol 

15 does not support selective retransmission. 

28. The communication system of claim 22 wherein 
the communication application is configured to limit 
accepted requests from client communication systems to 
communicate with server applications based on a total 

20 allocated communication rate of accepted requests. 

29. The , communication system of claim 22 wherein 
the server communication system further includes a server 
table identifying server applications for which the 
communication application is configured to pass 

25 information to a client communication system. 



30. The communication system of claim 29 wherein 
the server communication system further includes a module 
for accepting information to update the server table. 



WO 99/01968 



PCT/US98/11928 



- 84 - 

31. The communication system of claim 22 wherein 
the communication application is configured to pass 
information between more than one server application and 
a client communication system over a single transport 

5 layer communication stream. 

32. The communication system of claim 22 wherein 
the server communication system further includes a server 
table used to identify server computers with which client 
computers are permitted to communicate. 

10 33 . The communication system of claim 22 wherein 

the server communication system further includes an 
address translation table for associating network 
addresses provided by client communication systems as 
identifiers of server applications with local network 

15 addresses used for communicating between the 

communication application and the server applications. 

34. The communication system of claim 33 wherein 
the address translation table is configured to associate 
more than one local network address for each network 
20 address provided by a client communication system/ and 

the server communication system further includes a server 
selection module for selecting one of the local addresses 
in response to a request to communicate from a client 
communication system. 

25 35. The communication system of claim 34 wherein 

the server selection module includes a table for storing 
an association between a client communication system and 
a selected local network address. 

36. The communication system of claim 22 wherein 
3 0 the transport layer module includes a rate control module 
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configured to control a total rate of communication to 
each client communication system. 

37. The communication system of claim 22 wherein 
the communication application includes a cbmpression 

5 module for compressing information passing from a server 
application to a client communication system. 

38. The communication system of claim 22 wherein 
the communication application includes an encryption 
module for encrypting information passing from a server 

10 application to a client communication system. 

39. A communication system comprising a server 
communication system coupled over a data network to a 
plurality of client communication systems, the server 
communication system including: 

15 a transport layer module for communicating with 

the client communication systems using a plurality of 
transport layer protocols; 

a server application; and 

a layered communication module coupled between the 
2 0 transport layer module and the server application for 

receiving requests from the server application to accept 
communication from the client communication systems, for 
maintaining a transport layer communication stream with 
each of a number of the client communication systems, for 
25 accepting requests over the communication streams from 
client communication systems to communicate the server 
application, and for passing information between the 
client communication systems and the server application 
over the communication streams. 

30 40. The communication system of claim 39 wherein 

the server communication system further includes a server 
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computer coupled to the data network and programmed to 
implement the transport layer module, the server 
application, and the layered communication module. 



41. A method for communicating between a client 
5 communication system and a plurality of server 

communication systems over a data communication network 
comprising: 

accepting a request to communicate including 
receiving an identification of one of the server 

10 communication systems; 

using the identification of the server 
communication system, selecting one of a plurality of 
transport layer protocols for communicating with the 
server communication system; and 

15 communicating with the server communication system 

over the data communication network using the selected 
transport layer protocol. 

42. The method of claim 41 wherein selecting the 
transport layer protocol includes determining a set of 

20 one or more transport layer protocols for which the 

server communication system is configured to communicate. 

43. The method of claim 42 wherein determining 
the set. of protocols includes accessing a server table 
and retrieving information related to the server 

25 communication system. 

44. The method of claim 4 3 wherein determining 
the set of protocols further includes updating the server 
table based on data received from the server 
communication system. 
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45. The method of claim 42 wherein determining 
the set of protocols includes retrieving information 
related to the server communication system from a 
directory computer over the data communication network, 

5 and wherein the address of the directory computer is 

related to. the identification of the server communication 
system. 

46. The method of claim 45 wherein the address of 
the directory computer is the same as the address of a 

10 server computer identified in the request to communicate. 

47. The method of claim 41 wherein accepting the 
request to communicate includes accepting a request to 
communicate with the server communication system using a 
requested transport layer protocol for which the server 

15 communication system is configured to communicate, and 
the selected transport layer protocol is different from 
the requested transport layer protocol. 

48. The method of claim 41 wherein accepting the 
request to communicate with the server communication 

20 system includes accepting a request to communicate with a 
server computer at a first network address over the data 
communication network, and wherein the method further 
includes selecting a second network address for 
communicating with the server communication system, and 

25 wherein communicating with the server communication 
system includes communicating with a computer at the 
second network address. 



49. The method of claim 48 wherein the second 
network address is different from the first network 
3 0 address. 
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50. The method of claim 41 further comprising: 
accepting a request for information through a user 

interface; 

providing a request to communicate with a server 
5 communication system based on the request for 
inf ormation; and 

providing the requested information through a user 
interface . 

51. The method of claim 41 wherein accepting the 
10 request to communicate further includes accepting a 

request to communicate from a client application over a 
local data network. 

52 . A method for communicating between a server 
communication system and a plurality of client 

15 communication systems over a data communication network 
comprising: 

establishing a first transport layer communication 
path between the server communication system and one of 
the client communication systems using a first transport 

2 0 layer protocol; 

receiving" over the transport layer communication 
path a request from the client communication system to 
communicate with .a first server application; 

establishing a second communication path to the 
25 first server application using a second transport layer 
protocol ; and 

passing communication between the client 
communication system and the first server application 
over the first transport layer communication path and 

3 0 over the second transport layer communication path. 

53 . The method of claim 52 wherein passing 
communication includes selectively retransmitting data 
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not correctly received by the client communication 
system. 

54. The method of claim 52 wherein passing 
communication includes limiting a total rate of 

5 communication with the client communication system. 

55. The method of claim 52 further comprising: 
receiving over the first transport layer 

communication path a second request to communicate with a 

second server application ; 
10 establishing a third transport layer communication 

path to the second server application using the second 

transport layer protocol; and 

passing communication between the client 

communication system and the second server application 
15 over the first transport layer communication path and 

over the third transport layer communication path. 

56. The method of claim 55 wherein the first 
server application and the second server application are 
the same and the second transport layer communication 

20 path is separate from the third transport layer 
communication path. 

57. The method of claim 55 further comprising 
accessing an address translation table and determining a 
local network address of the first server application. 

25 58. The method of claim 55 wherein passing 

communication includes limiting a total rate of 
communication with the client communication system. 

59. A method for communicating between a server 
communication system and a plurality of client 
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communication systems over a data communication network 
comprising: 

establishing a first transport layer communication 
path between the server communication system and one of 
5 the client communication systems using a first transport 
layer protocol; 

receiving over the transport layer communication 
path a request from the client communication system to 
communicate with a first server application; 
10 determining whether to accept the request; and 

if the request is accepted establishing a second 
communication path to the first server application using 
a second transport layer protocol, and passing 
communication between the client communication system and 
15 the first server application over the first transport 
layer communication path and over the second transport 
layer communication path. 



60. The method of claim 59 wherein determining 
whether to accept the request includes accessing a server 

20 table identifying server applications for which 
communication should be passed. 

61. The method of claim 59 wherein determining 
whether to accept the request includes determining 
whether accepting the request would exceed a total 

25 communication capacity. 

62 . Software stored on a computer readable medium 
for causing a computer to perform the functions of: 

accepting a request to communicate including 
receiving an identification of one a plurality of server 
3 0 communication systems; 

using the identification of the server 
communication system, selecting one of a plurality of 
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transport layer protocols for communicating with the 
server communication system; and 

communicating with the server communication system 
over the data communication network using the selected 
5 transport layer protocol. 

63. Software stored on a computer readable medium 
for causing a computer to perform the functions of: 

establishing a first transport layer communication 
path between a server communication system and one of a 
10 plurality of client communication systems using a first 
transport layer protocol; 

receiving over the transport layer communication 
path a request from the client communication system to 
communicate with a first server application; 
15 establishing a second communication path to the 

first server application using a second transport layer 
protocol ; and 

passing communication between the client 
communication system and the first server application 
2 0 over the first transport layer communication path and 
over the second transport layer communication path. 
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